The 27-year-old, who was named player of the year last season for Steve Tilson's side, is set to put pen to paper on a three-year deal.
He told the Southend Echo: "It's been a very hard decision for me but I've been made an offer which I don't think I can turn down.
"My wife's dad isn't too well at the moment. He's having treatment and moving back to nearer where we're from will enable her to see him a lot more.
"The length of the contract at Huddersfield also gives us some security which is important as I have my little girl to think about
now but I'm leaving with a heavy heart.
"It's been good and I have some great memories from my time at Southend."