To create a class, first select the class dropdown then you will see a list of your classes. At the very bottom of your list of classes, you will see a (+ New Class) button. Select this to create a new class
Here is a quick demonstration of the different settings inside of the class creation
See the full Setup Class article for details on the different class settings