Software Engineering / Programming does not typically require much from you in a mathematical sense, although having good mathematical skills will help you.
Computer science does require mathematical skills from you. It is an important part of many topics such as Artificial Intelligence, Algorithms, Data Structures, Machine Learning, Computational Complexity, Machine Architecture, etc…
The most important question you have to ask yourself is “Am I willing to struggle with ____ to make myself a better computer scientist or programmer?” If you are worried about your skillset not being sufficient and don’t think you can keep up, you can develop these mathematical skills as you go! If you are trying to see if you can “get away” without having to learn more, that attitude will not get you far in programming or computer science, as this is a field that is often innovated (and sometimes reinvented). Programming languages and paradigms may rise and fall, but problem solving skills will always be required in computer science.