IR35 was brought about by the government to ensure small companies especially contractors and freelancers, operate their own limited companies in a right and proper manner.
Meaning that they had the same level of risk, responsibility, liability and control that other directors of limited companies accept, when they manage their own businesses. You will most definitely be caught by IR35 and found to be inside if you have the same level of risk, responsibility, liability and control as a permanent member of staff.