I've seen a lot of people do this, and every time they have Jotaro not being able to speak a word of english. I highly doubt that, especially with an american mother. You think Holly wouldn't speak english to Jotaro at all?
Also Joseph would definitely not speak a word of japanese, lol. It seems very out of character for him to be speaking another language fluently.