It depends.
If you ask with the intention of transferring to Vellore for your degree’s term, then the answer would be a No.
You would have loads of opportunities to visit the Vellore Campus especially at times such as Riviera and Gravitas (Read Festival Times), and during placements. Even otherwise, VIT Vellore hosts many competitions, workshops and seminars which will be open to people from Chennai. The best bet would be to join a club or a sports team, as they usually frequent the Vellore Campus.