Consider putting all your changes in a child theme. Look at my child theme as an example.

add to functions.php in your theme:

https://wordpress.stackexchange.com/questions/120418/completely-disable-categories
http://stackoverflow.com/questions/4249694/how-do-i-remove-a-taxonomy-from-wordpress

Also on: