Please note that TeamMaha is committed to bringing you insults on the regular because they never teach you how to say something or someone is absolute shit in school, DO THEY?
Anyways: this phrase has nothing to do with speech, and everything to do with quality. For example: شغل اي كلام (sho3’l ay kalam) means ‘a crappy job’ (as in someone did a crappy job of something), بيقول اي كلام means something to the effect of ‘he’s just saying whatever’ and رحلة اي كلام means ‘a lousy/low-quality trip’ (literally ‘an any speech trip’ which just makes no goddamn sense at all).
The opposite of اي كلام is often نظيف (ndeef) which literally means ‘clean’ and implies that something is done well–hence: انا مش عايزة رحلة اي كلام يعني, عايزة رحلة نظيفة= “I don’t want just any trip, I want a good one.”
Other colloquial uses of كلام that come to mind right now:
الكلام دا = ‘that sort of thing’ (ماليش في المذاكرة والكلام دا = I’m not one to really study and that sort of thing)
هو بتاع كلام = ‘He makes shit up all the time.’ Another related word: بيحوّر, a verb meaning basically the exact same thing. I could actually give you like five more synonyms for this right off the top of my head (why are there so many different ways to say ‘he’s a bullshitter?’ in Egyptian) but these will hopefully suffice you for now.