The latency isn't an issue, the timing becomes an issue because you don't have a clean signal at some point, meaning the signal will arrive "spread out" over time. If it spreads to the next signal, your GPU isn't recognized anymore.
But as long as.that doesn't happen, there is no latency or performance decrease.
Wow, we only vacuum once a week, that's it. Maybe its because my tower is on my desk? Or our air is just really clean for some reason...