Yes....no....maybe
It all depends on your budget....if limited [like mine] you need to get the best out of what you have. So modding can form part of the upgrade path.
An AV amp will benefit the same as a stereo amp......though I'm unfamiliar with the one you have. Look at replacing input sockets , mains leads, IC's, opamps, for starters.