Yes, that was highly offensive, but I still wouldn't have associated it with a bowling ball. If I think about bowling balls I know they (often?) have holes in, but that's pretty much the extent of my bowling knowledge.

There's a difference between "saying something negative about a black person" and "invoking a racist trope", whether deliberately or accidentally.