Ran the bike at 2000 rpm steadily and released the bolt that stops the tensioner. I can hear that with the bolt undone, the sound changes (tensioner moves) and once I tighten the bolt back down, the sound disappears again.
However, the humming noise while riding has not disappeared.
So, I decided to just take it as it is, and give 'er the beans.
Ride for >30 minutes, oil nice and hot. Sound does not change. Bike runs great.. It is what it is.