Thinking and Qualitating

First and foremost, the most important quality of Qualitative Research is that hypotheses come from the research rather than having to come up with my own hypothesis and test it. Being new in the field, and it will take me years to not be “new,” grasping this understanding of Qualitative Research is such a relief. So far in my education, the only real distinction between Qualitative and Quantitative Research is really about the results they produce; however, that limited information does not inform my decision-making when designing a research plan. Also, until now, I have been thinking my research will be predominately multi-strategy, incorporating both. But after this new adjustment, I feel a little off-the-hook for designing more complicated research plans. As of now, in order to help grow my knowledge in the field, I can primarily focus on Qualitative Research. I imagine in making this my focus, I will be in a constant state of discovery when it comes to research, and honestly that is less stressful. There is not much I really need to already know before doing research outside of ethical and rigorous research methods.

After my initial practice with gathering field notes, I am certain I have no idea what I am doing. I have always been one to notice small details in the world around me, but that doesn’t mean that the small details I notice matter for research. Further, I don’t exactly know what kind of information, broad or specific, we should be looking for. Meranda, my classmate, had this plan in her mind about how to go about gathering field notes, and while her quick description of what she was doing helped me to think differently about how to gather field notes, it wasn’t enough for me to gather notes effectively on my own. So, I definitely need to know more about that. I mean, what’s the point of gathering information if it isn’t the right information? Then, once we gather that information, what do we do with it? No clue. 🙂

I am glad I am taking this class now, at the beginning of it all.


Design Not Method

I’ve said this before and I’ll say it again: I think qualitative research makes sense to me. As a teacher, I am constantly watching and asking interview style questions of my students as they work. I think we do need qualitative research because including the experience of a person alongside of their performance helps to capture the whole picture of an experiment. That is necessary when your experiment revolves around humans. However, what seems to be the challenge is dealing with the data. It is hard to imagine, and imagine is all I can do at the moment, how someone would deal with the data produced by a qualitative study.

My view point of qualitative research is positive so far because my research deals with people, relationships, and meaning. However, I could see how people could have a negative view of qualitative research. It seems more difficult to interpret the data produced from a qualitative study. It is because of this that some people could question the validity of the results in qualitative research. The thing is though, relying solely on quantitative research doesn’t seem to give the whole picture of the research problem or situation. Further, the results of a quantitative research study could be just as questionable as well depending on how the research design was implemented and the quality of the questions being asked.

Overall, it seems that both methods are at risk of questionable data if the quality of the research design is weak. Ultimately this is reflection on the researcher(s). So, it seems to me that whether it’s qualitative, quantitative, or multi-method, the data you get is a reflection of the quality of the design implemented. This means to me that it really isn’t about the method; it’s about the design.


I think qualitative research makes sense to me. As a teacher, I am constantly watching and asking interview style questions of my students as they work. I think we do need qualitative research because including the experience of a person alongside of their performance helps to capture the whole picture of an experiment. That is necessary when your experiment revolves around humans. However, what seems to be the challenge is dealing with the data. It is hard to imagine, and imagine is all I can do at the moment, how someone would deal with the data produced by a qualitative study.

With a survey, you can use different programs to calculate response percentages. These programs, in essence, are your collaborators since the program will make it easier to compare demographics with responses which will help to highlight patterns and so forth. But, dealing with the data from interviews seems more daunting. It is definitely something I would need help with from collaborators because how do you do it? A spread sheet?? The thought of recording responses from several interviews sound as exciting as doing the dishes… which is not exciting at all. So, I definitely think collaborators are needed.

As a younger student, working with collaborators seemed like I was cheating in some way. I felt, at the time, that the work would have to be solely mine. There is probably a little arrogance built into that perspective as well, but now, I feel certain, especially with qualitative research, that I will need help. It is interesting that this method seems so intuitive yet that processing of the results seems so foreign.

A Little Proposal: A Work in Progress

Just a blurb from what I am currently working on since I haven’t posted recently:

Collaboration: What could it look like in the K-12 classroom?

Collaboration is a hot word these days in the education field. It is listed as one of the 4 C’s of the 21st Century Skills: collaboration, communication, critical thinking, and creativity.  According to the Report, collaboration is “defined by the William and Flora Hewlett Foundation as the mastery of content that engages students in critical thinking, problem-solving, collaboration, and self-directed learning” (2017) which is a major focus in education right now.  In professional development for K-12, collaboration is integrated into at least half of the training sessions, if not more. The problem is that collaboration is never really defined in a practical way for the classroom or taught how to actually do collaboration outside of using a tool like Google Docs. In The Horizon Report for Higher Education, collaboration is a listed as one of the “short-term trends” for 2017, meaning that collaboration is helping to “drive technology adoption now but will likely remain important for only one to two years either becoming commonplace or fading away in that time.” The Report goes on to link collaboration to deeper learning claiming that this kind of deeper learning is necessary for “student motivation” and ultimately to understand the “connection between their coursework and the real world” (2017). Surely if collaboration is part of deeper learning then it cannot be a short-term trend that will just fade away. Rather, collaboration is more likely to become commonplace and therefore less likely to draw research. So why is this important to K-12 teachers? The theoretical meaning of collaboration is at best limited and the practical application of it vague. If collaboration is a foundational element of deeper learning, and it is a current trend driving technology adoption, then it is necessary for both teachers currently in the classroom as well as administrators making technology adoption decisions that collaboration be more concretely defined and measureable research be done so that the power of collaboration can be harnessed more effectively.

Over the last two decades, collaboration generally has come to mean creating knowledge together, but that manifests in different ways. One way to do that is to assign more group projects in the classroom where the final product is on where everyone contributes to the final effort. Another is to have some version of an open forum where students work to create a body of knowledge together, where they become an expert and contribute to the end product as an expert like a wiki page or a blog. The goal of both versions of collaboration is to create knowledge together rather than alone. According to Lev Vygotsky’s “zone of proximal development” theory and his idea that we are smarter together than we are alone, just working together seems to fulfill his requirement for collaboration. However, collaboration is much more complicated than that since Vygotsky’s theory doesn’t account for the social dynamics of collaboration when the social dynamics fail. Vygotsky’s theory only describes learning as social under the assumption that all parties are motivated and engaged. In real classrooms, that is not always the case. It is not hard to imagine a classroom where half of the students are trying to Snap Chat on their phone or watch YouTube videos instead of learn something new. Therefore, a more concrete understanding of the dynamics of collaboration is needed in order to engage them. So, one possible definition of collaboration could be interdependent learning. Interdependent learning happens when all students in the group are needed in order to produce the final product or complete the tasks. But, how do we design lessons and projects to do that? Designing with collaboration in mind has at least 5 key components necessary to create more effective and rigorous collaborative learning environments: creating a culture of listening and communication (Kipp-Newbold, 2010; Atkins,2010; Stacey, 1998), creating opportunities for students to be experts (DeCosta, 2010; Chen, 2017), designing lessons/projects that are role specific (Widodo, 2013; Wilhelm, 2012; Srba, 2014), provide reflective assessments that hold all accountable (Dreamson, 2017; Scalise, 2016; Szewiks, 2011), and providing opportunities to change roles within the group to expand individual expertise (Kipp-Newbold, 2010; Dickey, 2007).  Each component on the list is meant to provide more robust guidelines to support the instructional design when integrating collaboration into lessons or projects.


The end, but also not the end.

The Secret to My Survey Success

Surveys take a lot of critical thinking. You can’t just be in robot mode and “wing it” like it’s the Friday of Homecoming during your high school English class with students going wild. Just like any essay or presentation, you should make a draft or two before you create it in a survey program. Question design can’t just be about curiosity or it just sounding like a “good” question. They need to be questions that actually generate data that can tell you something. If questions are too general or unclear, then there are no real valid conclusions to be drawn. However, if a survey is repetitive and long, you might also lose the interest of your participants. Therefore, creating surveys takes critical thinking, but also discernment. Without much experience creating surveys, discernment is difficult on your own. So, it seems reasonable that when creating a survey,  you collaborate at some point in the process. Collaboration with a coworker or someone with just fresh eyes can help you be more specific, revise for clarity, and pinpoint missing questions.

I think I have it in my mind that as I progress as a professional that I need to be creative and clever all on my own. However, as I grow, I have learned to work smarter rather than harder. In order to actually be smarter, I need more than me. Lev Vygotsky speaks to me more and more the older I get. So, it both surprises me as well as does not surprise me that seeking social validation of questions for a survey is encouraged.  Why not ask my husband if my questions make sense? Why not view my work with a classmate for validation and revisions? Why not do a test run of my survey with fresh eyes? It not just makes sense; it also makes the task easier!

In fact, I think the hardest part of making a quality survey is working alone.

Is Quantitative Data Intuitive?

It’s hard to say that I’m not a “math person” when I love to 1) solve problems, 2) use logic, and 3) look at data. However, and this is a big HOWEVER, there something about creating data that does not feel intuitive. Learning most things, outside of musical instruments, typically feels intuitive for me. But, when reading a chapter on Analysis and Interpretation of Quantitative Data, my eyes start skimming for what seems important to highlight. The descriptions and advise given do not engage my attention or help me to envision what it would look like if I were actually doing the collection and displaying of data. I think in this instance, I need to do something more tangible, kinesthetic, with these new processes.

It is similar to following maps for me. I have spent many years traveling, mostly on my own, sometimes using hand held maps and sometimes using street maps at bus stations. Either way, I don’t really get lost. I see the map with my eyes, I study the main layout of the area, then I can envision the same thing in my head. It isn’t an exact copy, but I noticed enough to help me make good decisions on the way so that I don’t get turned around. However, when you put me inside a digital game and give me a map, I get lost. Seriously. I cannot figure out how to get to any location and often get separated from the group because I turned the wrong way for a split second. When I turned back, the group is gone. I will admit to running a zone for an hour without having actually done anything because I got stuck in some mountain region. I usually have to get my husband involved to make it make sense. It makes me feel totally incompetent, but I also know in real life that this is so easy for me.

I figure it will be the same with the data. Stuck in the textbook, I will just be lost but put me in a real life situation, I can handle it.



Using Surveys for Quality Data Collection

Before I read this chapter over surveys and questionnaires for research, I just thought surveys were annoying because the surveys I am thinking of are the ones from Subway where you can get a free cookie if you fill it out.  I totally get wanting feedback on how your store is doing, but honestly I don’t think it is a valid source for businesses to reward stores and employees. I used to work at places that gave incentives for surveys, but while you get the survey filled out, how real is the data? If I want a cookie, I’ll give you all 10s because I don’t care about to store’s improvement; I care about getting the free cookie. However, after reading this chapter, I think surveys and questionnaires could be pretty useful pending on the willingness of the participant to give real feedback. What incentives can we give to help get participants actually involved? I know if there is no incentive, I still don’t care about it! So, this chapter really got me thinking of ways to attempt to get genuine feedback from participants but also having a quality sampling. I don’t have answers yet; I think that comes with experience.

Quantitative Research Design

What seems most interesting about quantitative research is that it what it produces, if done ethically, are results that seem reliable and reproducible. So, if I am trying to solve a problem, and I use a fixed design to test out a solution, the design can (should) be replicated in other situations and environments. The process itself seems more controlled and intentional so that its results seems more credible and reliable. I think using this method will help to create generalizations that are general conclusions drawn from the evidence discovered in the research design. This kind of inferencing can help an overall understanding of whatever your topic/issue is. It can address what is typical but maybe it can’t address what is not typical. What I mean is that I often read or hear about practices that work in the classroom that I try out in mine, but I don’t get the same results. I don’t know if it matters that I teach low income students who speak two languages and often don’t value education. Were those conditions considered in developing those practical ways to teach students? More often than not, they were not considered. So I think quantitative research can help recognize patterns to help generalize what it is typical but I am not sure if that kind of research applies to the classroom at all times. So, I am drawn to fixed design for the structure and replication aspects of it, but I also recognize it is not an all-encompassing design model.

Ethics in Research

I think what I am most concerned about ethically when doing research is my own ignorance. My background in research is 100% historical research and/or literature analysis, no studies of humans. So, I haven’t been trained to be aware of possible effects of the research I will do. Similarly, I hadn’t considered that providing a technology intervention should be considered a form of treatment. If I was handing out pills, I would definitely be more cautious about testing out my theories on people, especially on students which is predominately my research field. I have done my NIH training, and it was a little overwhelming. In fact, my first response was “umm is this really the kind of research I want to do??” Ha! Then I remembered that I want to solve problems for teachers and students, so this kind of research is what it is going to take.

I have the same concerns about the IRB approval process. I am not interested in wasting the time of the faculty or the IRB committee by submitting an application that shows my ignorance. So, I really need to know my resources for constant review to help me in the IRB application as well as for my own research design. One of the requirements in our research is do not harm. It had never occurred to me that anyone in Learning Technologies could do harm! That is because my previous perspective of research had nothing to do with studying humans directly. Further, I am not clear on when to do IRBs. What is the timeline? What can you do when you are waiting on approval? During our meeting, Dr. Warren said when getting IRB approval on minors, it could take between 2-4 months. So, I am concerned about time management since my work will be focused on students.

Just Thinkin’ ’bout Research

At this stage in my career, I am definitely more concerned with practical research questions rather than theoretical. What draws me to practical research is my job. I currently work in the classroom. I am constantly evaluating and adapting my process even within the same day in a different class period. I have a great group of students who have a particular set of obstacles to overcome. So, when I think about spending my limited free time on research, I want to have practical answers to help my students. Further, I want to find real solutions that work in the classroom. I want to witness the effectiveness of some aspect I’ve researched for my specific students that actually works. What’s more, if it works for me, I want to share it. I don’t have a problem with theoretical research; it just feels less important than practical research.


I guess to start, my first research question is What is collaboration? I want to know what definitions are out there. I am specifically looking for versions that lean towards interdependent learning structures and assignment design. Then, I’d like to test out some version of interdependent learning style collaboration on a group of my current freshman in high school. I would like to take a 6 weeks, possibly the 6 weeks teaching Romeo and Juliet where I have two of my four classes integrating  collaborative assignments and two classes using the traditional group work style assignments. I’d like to do two for each side since time of day and class size really affects student participation and involvement. For example, first period of the day is one of the most difficult to get students to work with anyone. They are tired and don’t want to talk to anyone.  Also, the last period of the day is often more rowdy and harder to keep focused. Group work easily shifts to social time since they  just got back from lunch. So, I’d like a wider group for each style of teaching/learning. As far as data, I’d look at the level of analysis in their final project as well as the data from a multiple-choice test.