The Canaries - relegated at the end of last season - were drawn against fellow League One side Yeovil in the first round of the Carling Cup on Tuesday.
And boss Gunn was keen to emphasise that, beyond the obvious benefits of progression in the competition, it would also cultivate a winning culture at the club.
"We go into every game looking to win and the Carling Cup is no exception," he told the club's official website. "It gives a chance for us to put together a run and hopefully reach the latter stages of the competition.
"Yeovil are obviously one of our fellow League One teams so it's an early chance to assess them with a view to the two league games we will play against them.
"The winning mentality is something we want to get back into the club and that obviously includes cup competitions as well as the league so we will be going to Yeovil looking for the victory."