Overall Quality of the Work

1. Based a reading of Micah’s candidate statement, we are unable to determine whether he experienced challenges and learning opportunities. There is no apparent attempt to discuss how the work has challenged him or presented new learning opportunities. 
2. He discusses much of his prior history before arriving at IU. A visual timeline might be handy. It could help Micah reflect on his prior as well as his current challenges and opportunities.
3. Micah is a seemingly capable student but we are struck by the lack of focus and the inability to present reflective insight. Moreover, there is an inordinate number of typos, which is of some concern.
4. The first sentence under the section on goals is unclear. Micah’s reasons are not “likely obvious.” We understand that he wants to design tools to help people learn, but even this statement lacks precision. Further, his writing does not reflect an appropriate academic style (citations and references) typical of doctoral study.
5. We are not sure how the first study (“Searching for Personal Territory in an HCI Design Studio”) relates to tools to help people learn or to help people instruct. There are obvious unstated linkages. However, we feel Micah needs to state them, not just imply them. We are also certain that he grasps the connection, but it is not apparent in his statements.
6. We are fairly certain that the intent and effort to align proposed activities with stated goals is there, but it has not been communicated.
7. We are not sure what the scholarly agenda is, so we cannot say whether or not Micah has reduced or dropped off activities that no longer contribute effectively to his scholarly agenda.

Knowledge of IST Content Areas

1. There is no evidence of a grasp of major ideas and theories within the declared focus area. It is striking that Micah’s statement is devoid of ISD methodologies; theories of learning and instruction; models for analysis and evaluation; theories about social and technical systems; history, foundations and future directions; research in IST; etc.
2. There is some evidence that Micah draws in relevant knowledge from areas outside the primary focus area when appropriate, but it is not emphasized, connected or described in a meaningful way. He has much knowledge about programming, HCI, and second language learning. This can help inform his research goals and interests.
3. There is no evidence that Micah’s use of knowledge from multiple areas displays understanding of the theories, their relationship to his work, and their applicability to his work.
4. Minimal information is provided about his research scope, intents, knowledge, interests, etc.

Candidate Demonstrates Strong Competence in Research

1. We are unclear as to Micah’s research agenda. He seems to have wide interests that lack any specific focus.
2. He has few published articles.
3. He has a few conference papers—IST Conference, AECT, and Meaningful Play.
4. No research philosophy is presented, so we cannot judge whether it is appropriate for his research agenda, which is also not clearly stated.
5. Micah needs coaching on how to present/showcase his research competencies. The discussion and evidence presented is almost not credible.
6. It is good to see he has reviewed papers.
7. There is an appropriate amount of evidence presented for his research competencies, some of it quite interesting.  Micah does a disservice to this evidence by not effectively highlighting it in his statement. 
8. The Adobe Connect Pro archive files of his talks are valuable.
9. Micah still needs a well-articulated research agenda. The next step is to pick the most seminal scholarship and research germane to this agenda, study it, emulate it and then take it in the direction he wants to go.  We need to see a plan to acquire research competencies not yet acquired.
10. Where’s the beef? Publications = nill?

Candidate Demonstrates Strong Competence in Teaching

1. There is no articulation of a teaching philosophy, so we cannot judge its appropriateness for Micah’s focus area.  The statement is more of a reflection on what was learned from teaching; this should then be translated into a teaching philosophy.
2. Micah seems committed to his teaching, but it would be nice to have a summary table of his experimental teaching approaches as well as those which are tried and true (i.e., the ones that consistently work for him).
3. One semester, Micah experienced fairly negative reviews and decided to reflect on it and improve his teaching.
4. He has exhibited a passion for teaching.
5. He has a wide range of teaching experience from children to corporate employees.
6. There is much creativity in his teaching.
7. Many teaching and learning resources are provided.
8. It is a good sign that he teaches for IU while a graduate student.
9. Sufficient evidence is presented teaching competencies already acquired. More than enough, in fact.
10. Syllabi and sample projects are provided.

Candidate Demonstrates a Commitment to Service

1. Micah has served the department well. He is a solid department member.
2. We recommend that he expand his service in a manner that enables him to serve and gain exposure to research and other scholarly organizations.
3. There is evidence of positive course evaluations.
4. As indicated earlier, at least one course evaluation indicated significant areas in need of improvement. Micah appears to have reflected on these and improved them.

Oral defense

1. The oral defense was generally positive. There was confidence, a high display of verbal skills, and significant eye contact. The 15-minute presentation was well organized and easy to read.
2. Micah had extensive difficulty naming key figures and theories in instructional design, instructional design theory, HPT/HRD, and learning theory. There was a noticeable lack of depth within his responses to many questions related to the historical grounding of the field of IST. This was a huge concern among all IST members.
3. While still in need of greater depth and experience, we were more impressed with the outline of his research activities in his presentation than in his dossier file.

Evaluation

Micah has two tasks to complete by the end of the semester (i.e., December 16th). These must be submitted for review to his program committee (Professor Boling and Professor Frick). If late, he will fail his qualifying examination.

1. Write a 25-page double spaced paper (exclusive of references and appendices) on the following: How would you position your work historically in the broader field of IST and HPT. Describe the field along with the major thinkers and their ideas. You should include appropriate names, references, dates, etc. Please also include information on where your research fits in relation to these theories, perspectives, or positions.
   Where I Fit Within IST
2. Create an annotated bibliography that Professor Boling might wish she had, that describes our field and gives an overview of the really important core concepts in our field. If needed, please consult Professor Boling for clarification or elaboration of this task.
   Readings in Instructional Systems Technology