Don’t get worried! There are many BITSians like you(me being the same).
I just got reminded of once a BITSian had said.
“If your wingies talk to you in English even after the first week in the college, It is not a so called ‘BITSian wing'”
However, at times you will feel yourself low(if you are not confident) while talking to English speaking population at BITS. Try learning from them instead of being ignorant. Confidence is what matters while speaking, language carries a lesser effect.
“Brutus was a good speaker, Antony was better”
No Doubt, fluency in English is highly imperative in life. Hence,there is no loss in learning English. BITS is a place where you can learn everything or nothing!