The defender moved to Villa on a three-year deal on Friday as boss Martin O'Neill beat Hull City to his signature.
Beye is now looking forward to returning to the top flight after suffering relegation with Newcastle last season, and he had no doubts about joining Villa.
"I think Villa is a great football club," he told AVTV.
"I was really happy when my agent told me Villa were interested. I just said, 'get it done'. I wanted to sign for this club.
"It's going to be great working for Martin O'Neill because Villa have a great team. I am so proud now to play here.
"It was important for me to stay in the Premier League and I am really happy I have with Villa. Newcastle are a massive club but everybody knows the problems at the moment.
"I think joining Villa is a great step for me. I signed my contract this afternoon and I'm really glad. I now hope I will be successful with Villa."