Even though machine learning field is growing rapidly, research on education of machine learning is scarce. In this paper a research about creating assessments in the machine learning’s context is presented. The aim of the research is to answer how to design assessments that reliably show progress on a module in machine learning. Learning outcomes and Bloom’s taxonomy are used to make the research reproducible, and draw conclusions. One of the main conclusions drawn in this paper is that verbs that are used in learning outcomes can also be used to find the appropriate question type (e.g. open ended, multiple-choice) to assess that learning outcome. Additionally, this paper concludes there is no strict procedure of creating assessment questions. Therefore, a guideline is created by the researcher and presented in the paper. Lastly, four questions are created using this guideline and evaluated with interviews with three machine learning professors.