Monday, October 4, 2010

Focus Groups and Reliability (or do you mean validity?)

Lunt and Livingston suggest that a focus group “...acts as a context that challenges, asks for elaboration, and demands examples of claims that people make. In rhetorical terms, the group acts as if conducting an inquiry, and there are, therefore, reliability checks in the operation of pragmatic norms for communication in groups” (93).

This is interesting on a number of levels. The authors appropriate the idea of focus group participants as agents of reliability. Assuming reliability is the accurate reproduction of findings in duplicate research then perhaps the authors meant to say validity, or more specifically, construct validity. Validity can be understood as a measure of representativeness of research findings outside of a controlled environment.

In this context, the authors compare focus groups to surveys, wherein it is mentioned that surveys can not provide for the same checks of reliability. How is it possible for any form of lightly structured interviewing technique to produce any form of significant reliability? It is clear that this becomes an issue of semantics, which in this case is quite apparent. It also appears to be apparent that the authors may have meant something different than they communicated.

Lunt and Livingston suggest that there “...are no such checks in survey research, which may be seen rhetorically as a highly reduced dialogue between researcher and researched” (93). If the claim relates to the truth value in participant responses, as the authors suggest, then there are indeed methods for controlling inaccurate, false, or misleading responses. Occasionally, the researcher may want to ask the same question, but reword it. This functions as a sort of double-checking, wherein respondents are tested on their focus during the survey. It is not as effective as face-to-face interrogation; however it is certainly possible.

Sunday, October 3, 2010

Construction and Conveyance of Meaning

I was at an academic/social event the other day, and upon being introduced as someone studying "information" and consequently having to explain what I am "interested" in, I had a curious exchange that, I think, is relevant to topics coming up in both Lunt/Livingstone and Luker. While (mostly) blathering endlessly about my varied interests in the history of information architecture, the confluence of information and human-computer interaction, and the materiality of wearable computers, I managed to spark my listener's interest by bringing up something that was... surprise... topical! I had read, earlier that day, that a team of Japanese physicists have managed to create an information heat engine, capable of converting information into energy. Of course, when I tried to explain how this heat engine would work, and what was the relevance to 1) my research interests and 2) the study of information, I immediately stumbled, trying to draw constellations of disconnected ideas together in an attempt to seem as if I knew what I was talking about. I assumed that I kind of did when I brought the topic up, but I am not a physicist, or an information architecture professional, or a nanoengineer.
Anyway, upon later reflection I realized that, instead of making myself (and my research goals) seem interesting, I probably had the opposite effect. Luker referred to synthesizing research and preparing your "material" so that it would be presentable to your smartest, harshest critics and colleagues. Paraphrasing Lunt and Livingstone, "The audience is seen, not as an aggregate of atomized opinions or attitudes, but as individuals located in concrete social groups who construct meaningful social action partly through the discursive interrogation of texts." (Lunt and Livingstone, page 85)
This is, of course, referring to a television audience in a completely different context. But reading this description has prompted me to think about my "audience" and how I convey meaning that I have haphazardly constructed. When I describe my research interests, I get a lot of blank stares. I suppose I need to think about whether this is a result of trying to fuse disjointed ideas and cultures of knowing on my part. I also need to decide whether the "audience" I'm speaking with has ever come across what I'm discussing, and whether it might be relevant to their interests. Finally, I need to situate my presentation - because, make no mistake, that's what this is - in something concrete and tangible. I imagine the latter will come as a result of taking a careful look at how I derive meaning from the themes I am interested in.  

The Bedraggled Daisy vs. The PhD Dent

Did anyone else see the "Illustrated Guide to a Ph.D." meme that made its way around the internet a few weeks ago? If not, I invite you see it here: http://matt.might.net/articles/phd-school-in-pictures/.

Luker's "Bedraggled Daisy" immediately brought this to mind. I think (hope?) that the author of the Ph.D. Dent may have had his tongue planted firmly in his cheek when writing it, the thoroughly demoralizing line "keep pushing" in particular. Still, it seems that the Ph.D. Dent may serve as an accurate representation of Luker's conception of canonical research and a contrast to the image of her Bedraggled Daisy.

I'm happy to see that the Bedraggled Daisy is working for some of you: I've been dutifully following the exercises that Luker provides at the end of each chapter though, to be honest, I haven't much benefitted from them -- the Bedraggled Daisy included -- despite my best intentions. Like Gabby I'm a natural inter-disciplinarian (or multi-disciplinarian, though these are slightly distinct in my mind but that's a post in itself) though I do value time spent in deep focus on a single subject: I wrote a thesis on a very specific subject as an undergrad (a particular image that Nietzsche used discretely throughout his writing) and it turned out to be one of my greatest accomplishments. Regardless, I'm finding it difficult to find that focus this time around and I've found that the Bedraggled Daisy has only compounded the problem.

Of all the exercises that Luker has proposed, her insistence on establishing a research question has been the most helpful for me. I don't normally frame research projects in terms of a guiding question but, at Luker's insistence, I'm attempting to do so this time around. And though it hasn't been a clear success just yet, the contortions that I'm forcing my mind to go through feel like good exercise. I've been asking myself questions like: how do things like contracts and agreements inhibit or constrain creativity, innovation, and rational behaviour? Is the info-glut phenomenon compromising our capacity for meaning-making? Is our ability to engage in productive, creative play being inhibited in the 'Information Age'?

Each of these questions reflects some aspect of my research interests (interpretation, meaning-making, play, and the contemporary limitation thereof) but none adequately encapsulates all of these interests. Still, I feel like this line of questioning is circling around something and that I'm getting closer to articulating a strong research question. That said, I'm sceptical that I'll be able to find a single, stable question that will guide my research from beginning to end, though I don't think Luker is necessarily advocating such a question. Is anyone else struggling with the research question?

Refer to the Goodies

It is really useful to look at how others have done to win the SSHRC so as to give myself a clue on how to write my own proposal. The SSHRC Number 2 ( musical knowledge) is a well organized example, so I would use the following reviews as a reminder for my own SSHRC proposal:

1. Program of Study Statement
In this section,the applicant has stated his/her personal live long endeavor in the research interest on music. The statement here has connected the writer's undergrad background with the current MI post-grad program. In this way, readers can at least ensure that the applicant is not researching on an alien field.

2. Context
The applicant has smartly framed his/her research method course as "a fruitful collaboration" with the course instructor, who is a specialist in ethnographic research. In this way, the applicant tries to give an impression that he/she has teamed up with the professor. Personally I don't like such claim, but apparently the SSHRC buys it.

The applicant also clearly identify the research needs, which is to fill the current research gaps.

3. Objectives
This is the part for the case study. The applicant has chosen a hot and sexy topic: flamenco guita. Even though I don't have a musical background, the flamenco guita at least sounds fascinating. Moreover, the research target is an RCM professor's studio, the students and the professor. The academic background of the research targets also sound like strengths of the research topic.

4. Methodology
Here the applicant refers back to the research method course instructor again. This time, it is not "collaboration". Instead, it is "under the supervision" so as to reassure the professionalism of the research methodology. Besides, the applicant has presented multi-layers and interdisciplinary research methods, which further ensure the plurality of the research project.

5. Contribution to the advancement of knowledge
This is the "why" section. The applicant mentioned that this research project can further inspire other researches on broader interdisciplinary fields such as "information science, ethnomusicology, music education and system design".

As learned from the Monday class, it matters the most on "framing" in the SSHRC proposal. The review on this music knowledge research proposal has reminded me one thing -- the SSHRC funders might know something about everything, but not necessarily aeverything about one thing. Therefore, the most important part in the proposal grant writing is the way that you frame your project, to make it relevant to the current and hot topics. Yet, do we have to do our own research project "under the supervision" of Sara?





Research woes

I admit I felt unsettled after reading the sample SSHRC proposal, which is intimidatingly organized and focused compared to my half-hearted attempt. My two passions are Islamic and information studies (my private fantasy is to achieve the impossible and become the first female librarian of Al Azhar's library, revolutionizing the entire collection to include liberal, revisionist views of Islam, and thus paving the way for reform in the Islamic world). Hey, I can dream!
The problem I am facing is developing a research question. The connection between interpretations of Islam and the dissemination of information, the monopolies of knowledge and intellectual freedom (or lack thereof) and censorship, Muslims' limited exposure to books versus their primary exposure to oral forms of communication (Friday prayer sermons, speeches and lectures by clerics) and the ensuing and corresponding mentalities / mindsets...these are all areas, not questions. And how do you study something so vast? Focus groups, one-on-one interviews, participatory research??
It's true that conducting research without a question is like groping in the dark; I have a lot of interests, but what am I really asking?

Friday, October 1, 2010

SSHRC Review

At the end of class on Monday we were asked to give our thoughts on a particular SSHRC proposal. The one that myself, Brian, Caitilin and 2 others from Group 4 received related to researching the people of the Stikine Plateau.

The author of this proposal clearly states the interest of study and it is clear that this person has a vested interest in the historical processes and development of the Stikine. Beyond geography, the author wants to take on recounting the historical process of colonialism and landscape change to the region. With limited research available on the topic and the region, it would appear the author has a vast amount of information to deal with and that the scope of this study seems enormous.

The method to be used is a review of literature available in the archives of British Columbia and in Ottawa. The author will also use personal papers of key individuals with connections to the Stikine throughout history which will be sourced at the Union of British Columbia Indian Chiefs Library and the Department of Indian Affairs RG 10 files which are housed at UBC Library. The author also cites references needed from Hudson's Bay Company, Archives in Winnipeg, the Alaska State Acrives in Juneau and the University of Washington Archives in Seattle. The author also plans on holding interviews in the region of the Stikine.

The author's intentions are clear: to contribute to the environmental history of Canada through the Stikine and make a significant contribution to Indigeneous-state/settler relations.

It doesn't appear that the author has left gaps, if anything it seems that the author has included every possible angle which may lead to some very confusing moments in the future as to what specific direction to follow. After reading this, not only do I feel that I have a lot more thinking to do about my own research project, but I want to be sure it will make a significant contribution to furthering the field.

Is it How or Why?


After the lecture on Monday and after reading both the article by Lunt and Livingstone on the use of focus groups in Media and Communications Research and Knight Chapter 3, I felt even more confused as to what "method" I should be using or proposing for my research proposal. So, I started by doing the following -- I took Eleanore's approach (through Luker) and created my research "flower". (see above). This has been really helpful in helping me to define the scope of what I'm interested in studying but now I'm left to ponder...do I have a "why" question which would call for more qualitatitive methods or a "how" question calling for more quantitative methods? I won't take you through the various iterations of my question, as I posed it on paper but I'm left with the following: How does the use of social networking sites, for children under the age of 13, affect their feelings of empathy toward their peers and the world? How do they understand the terms of use for the site and how do they perceive the open access of information that they are providing to their peers (among others)? I think I have a questionnaire in my future (and a whole lot of consent forms!)