Is it possible to cancel an optimization?

You can't cancel an optimization, but you can save a copy of the database before starting the calculation: if you're not satisfied with the result, you can import the old version of the timetables via the command Imports/Exports > EDT > Import the classes'/teacher's  timetables.