Having interest in computer is enough for CSE. When it comes to subjects, yes Maths would be there.
But career wise you require limited maths (10th standard). Generally a CS student require basic mathematics for programming. It’s required to have mathematical mindset for visualizing, how tiny is KB as compared to MB, ability to estimate O(n), O(log n). You will work most of the time with existing algorithms. Some programmer need to learn advanced mathematics because of business requirement but you’ll most probably need school level mathematics for programming & algorithms.
What can you do is stop fearing from Maths if you really have interest in computer. You need to work really hard to pass those exams but opting something that you don’t like would be bad decision. Success doesn’t come without hard work otherwise it’s not success.