Whether a topcase affects handling really depends on a few factors.
Most important is where your rack is located.
If it is on top of the rear wheel, that's actually the best place for it to be, as it puts weight where traction is normally needed when accelerating: above the driving wheel.
However, most rear racks are placed behind the rear wheel, to leave the pillion seat available. This is the worst place for a topcase to be, because then the rear wheel becomes a fulcrum to lever your front tire off the ground. This would definitely affect handling, most notably turning, as the front wheel becomes a lot lighter than what the original design of the motorcycle was intended for.
I had a Givi Maxxia 52L topcase on my old R12GS, it was mounted behind the rear wheel. Because it was 52L, I put 52L of stuff in it, and it was super-heavy. Inadvertent wheelies were a constant danger on steep hills.
Even if your rack and topcase is behind the rear wheel, other factors affecting the handling are how aggressively you ride and how much the topcase+contents weigh.
If you are not an aggressive rider in the twisties, you may not notice any difference as you do not rely on front end grip as much as someone who corners to the limit of adhesion.
Also, if your topcase and its contents don't weigh much, it won't lever the front as much as a heavier load, so handling may not be as affected. After a lot of close-calls, I left my 52L topcase pretty much empty when travelling, only loading it with groceries at the end of the day back to the hotel and storing lighter items like clothing in it.