VLC has its own settings for speaker outputs, first make sure those are right, then you can use Audio Midi Setup to configure the speakers using your own output as well. I'd start in those two places.