Monday, April 4, 2011

Re: Blog Post 8 - Testing Historical Knowledge

Gabriel A. Reich's article, Testing Historical Knowledge: Standards, Multiple-Choice Questions and Student Reasoning, addresses the following research questions:



1.  How can the knowledge and reasoning used by relatively
successful and unsuccessful participants to answer a set of 
multiple-choice history questions be characterized?
2.  Did the items evoke the thinking called for in the
standards?
  • qualitative study
  • knowledge and reasoning = used in multiple choice test taking per the Regent's exams
  • successful and unsuccessful participants = sampling from “Metropolitan School” which is a small, urban high school of fewer than 400 students - 15 students from a single 10th grade history class participated
The article explains the history, methodology, findings, discussion and conclusions for the above research questions. A small sample of 15 students in Mr. Heche's 10th grade history class at Metropolitan School (NY state) were given 15 multiple-choice questions, observed taking their "test" on historical topics and interviewed. The researchers used codes in their observations to assess students cognitive processes and used additional codes to express their inferences. The article provides many findings that point toward the tendency for teachers to focus on literacy skills and content knowledge in their teachings, vs. discipline-based skills, but that Mr. Heche did not do this. He did, however, abide by a curriculum that followed the test standards closely.

Questions:
  1. What was the motivator for using such a small sample size? (15 students vs. that many students from several classes) Was it due to the selection criteria and if so why wasn't that criteria modified so that the results using a larger sample could be more generalizable?
  2. If the research question is to explore how independent variables like knowledge and reasoning are to be classified - why was history, versus math, chosen as the test subject for the tests? 
  3. Did the objectives stated in the New York State World History and Geography standards use the same variables (cognitive processes) to express knowledge in reasoning or were those imposed by researchers?
  4. Would a rival hypotheses be to use an equal sample size with the same characteristics (class/test subject, SES, age, etc...) but with a teacher found not to be teaching to the test standards? If the results were similarly accurate could this add to the test's validity?
  5. Were there any events (history) that affected the outcome of the research?
  6. In the conclusion a generalization is made that teachers tend to focus on literacy skills and content knowledge in their teachings. Is this drawn from the literature research and not from the actual qualitative study?





Wednesday, March 16, 2011

What Causes to My Effect?

Revised research problem stated as a prediction study within a correlational design:
Predictor variables:
  1. exposure to natural light which includes an outdoor view including the horizon, expressed in hours/day
  2. reason for incarceration, expressed in type of non-violent offense 
  3. length of time already served, expressed in years
Outcome variable:
  1. violent behavior with other inmates and prison officers, expressed in number of reported violent incidences per month
Population: Non-violent offenders in low-security prisons
Sampling Frame: 3 specific prisons, yet to be identified
Sample: sample of prisoners representing different races and ages

I think it's a natural desire to search for the cause to an effect. Understanding why and how things happen provides an explanation and the ability to somewhat control the future. If we can understand what caused an outcome then we have a greater chance of manipulating that variable in a similar situation to our benefit.


In research, however, the determination of a causal relationship as one of the primary research goals can limit the observations made or data collected (problems). If my research question involved only two variables - say, the effect of an inmate's exposure to natural light has on the number of violent incidences in which that inmate is involved per month - then I would end the research with data regarding quantities and types of natural light as well as reports of violent incident frequencies and types. If the research showed a positive correlation between natural light and lower violent incidents I could claim, based on this research alone, that there is a positive correlation. However, I think this would be an example of an accurate but invalid conclusion. 


If the research topic has been previously explored and it has been determined there is a causal relationship then the new research can prove or disprove this. My research is the initial study and has a large number of variables. This seems fairly representative of social science research. 


By using a correlational design model that is predictive I can include several variables that provide additional context to the overall research and inferences made. A regression model can communicate the role in which the predictor variables affected the outcome variable based on surveys, reports and interviews.


Questions:
Would an Ex-Post Facto, quasi-experimental design model, be appropriate given the number of "pre-existing"  conditions participants may have?
Is a regression model the only communication tool, to express research outcomes, in prediction research as I've described above? 

Friday, March 4, 2011

Validity + Reliability

Original research problem:


The purpose of this study is to understand the effects of prison architectural design on inmate rehabilitation in 2011.


Revised research problem:


The purpose of this study is understand whether the architectural design elements employed in several prisons were perceived by prison staff and inmates as they were intended. 


The goal is to better understand how the architecture of juvenile detention facilities facilitate inmate rehabilitation.
  • architecture - space planning, volumetric changes / associations, ventilation, visual and physical access to natural light and other inmates / staff / community, materiality
  • facilitates - enables or hinders the activities of rehabilitation
  • rehabilitation - improvement in emotional and mental well-being that enables an inmate to function both in prison and out of prison in a way that doesn't harm him/herself or society
Measures


Specific architectural elements can be evaluated to determine their level of success by comparing data collected through architectural team interviews to data collected through prison staff / inmate surveys. The instruments or measurements would be interviews (and therefore the interviewer as an observer) and surveys.


Prisoner rehabilitation can be evaluated through post-prison release supervision statistics and surveys administered to inmates having served a majority of their term in a specific facility. The instruments would be surveys and credible sources. Would these credible sources be a part of the literature review or introduced in the body of the research with other instruments of measure?


These instruments are being used to measure the following variables:

  1. the architectural team's design intentions/strategies (opinions and documents)
  2. the inmate's reactions to the design strategies (opinions and statistics)
  3. the prison staff's reactions to the design strategies (opinions and statistics)
Validity + Reliability


Based on the definition of qualitative research:

"Qualitative  research uses a naturalistic approach that seeks to understand phenomena in
context-specific settings, such as "real world setting [where] the researcher does not attempt to
manipulate  the  phenomenon  of  interest"  (Patton,  2001,  p.  39) (The Qualitative Report, p. 600)


Reliability will be based on consistency in conducting interviews and administering surveys as well as the content of both measures. Specificity of the architectural elements in questions and effects being measured are important in providing data that can be compared between one or more sample groups from different prisons/different architectural teams.


Validity requires me (the researcher) to define the quality concepts being explored through the research. 
I'm still defining these but at this time I think the concept being explored is :
natural light as a tool to discourage violent behavior 
If I compare the amount of natural light (measured in square feet of glazing per cell / most consistently occupied space) accessed by inmates to the number of violent occurrences documented for those inmates - a possible correlation can be made. The challenge I am now facing is limiting variables like reason for incarceration (some inmates are more violent than others prior to incarceration), overcrowding, etc...


Resources:

The Qualitative Report Volume 8 Number 4 December 2003 597-607 
http://www.nova.edu/ssss/QR/QR8-4/golafshani.pdf

Friday, February 25, 2011

Research Ethics

In educational research, the most important ethical points to consider are those that concern the participants well-being, information regarding the participant's role in research and research goals. Full disclosure of the researcher's goals provides the participant with context surrounding his or her role.  Age can determine how and to whom the information should be disclosed. If the sample group contains students that are children or college-age, an Internal Revue Board may review the research project prior to allowing student participation. It is also important to consider participant's families and their opinions regarding the research topic, methods and goals. The need to disclose information to the research sample group, the group's families, and the organization through which participation is gained makes using minors as a sample group unique. 


Another important ethical issue, specific to educational research, is peer pressure. Whether the sampling frame is an entire school or just one class, a student and their family may be uncomfortable as the only subjects not participating in the research. The researcher needs to consider whether anonymity is required to prevent coercion or peer pressure. Anonymity can be extended to a participants status in the research as well as the outcome of their participation.


Unless considered necessary, incentives should be avoided. Although it is difficult to eliminate bias, not offering incentives allows potential participants to base their decisions on the merit of the research, not the incentive.

Friday, February 18, 2011

What is the problem?

Interior architectural design has a direct effect on an individual's use of a space and mental state while within a space. The purpose of this study is to understand the effects of prison architectural design on prisoner rehabilitation in 2011. Historical and conceptual analysis of selected prisons, their inhabitants, including staff and inmates, and architectural staff can provide data specific to place and population.


Questionnaires distributed to participants gather their opinions of various architectural design elements they experience on a regular basis. An additional group of participants from within the sampling frame may be the prison architects and interior designers involved in the projects although their involvement would involve interviews and not participation in questionnaires. They could possibly be involved prior to the questionnaire development to better assess architectural elements of significance.


Stratified sampling subgroups could include race, age, gender, reason for incarceration, facility type (high vs. low security) and participants could also be group based on the type of architectural design with which they inhabit. (style/era/concept) This type of probability sampling method could allow for results to be expressed as a generalization for the prison populations of the selected prisons. 

  • Pros: range of participants identified which provides more accurate participant data from which to base generalizations, questionnaires can be controlled to provide a consistent means of gathering data
  • Cons: opportunity for sampling error if sample size isn't representative of the population, lack of interest by participants in the questionnaire

An effective non-probability sampling method would be quota sampling. Inmates and staff from the above mentioned subgroups could be selected based on staff recommendations to provide the most diverse range of opinions. 

  • Pros: greater control over sample to lower the risk of sampling error
  • Cons: by involving prison staff in sample selection process there is an opportunity for bias towards inmates being selected and whether staff want their opinions known (prison politics)
I think that either sampling method could be effective. I question whether it is possible to not involve prison staff in participant selection. Quota sampling would allow me to create subgroups and provide direction regarding selection criteria. By involving staff in the selection process rates of violence, reason for incarceration and other inmate details could be discussed as well. The sample size is difficult for me to determine at this time. It depends on the number of subgroups or variables used and the number of prisons involved in the research.

Sunday, February 13, 2011

Architecture as a Tool to Debilitate, Protect and Control

This week's assignment required me to read at least two articles related to my research topic. I have provided summaries of the articles and then a brief analysis of the points I found most relevant to my questions for qualitative and quantitative research.


Article One 
Mobilong Independent Living Units : New Innovations in Australian Prison Architecture
The author briefly provides context for the Mobilong Prison in South Australia by describing its geographic location, inmate population and existing programmatic and physical structure. An increase in the inmate population required the Department of Correctional Services to expand Mobilong's facilities which led to the design and construction of the independent living units as a part of the new facility. These new facilities were given a more residential design than the existing prison in an effort to create a more humane, secure, safe and respectful environment for inmates and staff. Grant touches on project and client goals specific to inmate and staff participation in the design and construction project as a way to lessen the typical disputes associated with change in procedure or change in facilities. Aggressive and non-compliant behaviors were associated with inflexible, "hard", architecture. Human scale, color, visual and physical access to the outdoors are all attributed to greater inmate and staff safety and security. Space planning was listed as a tool used to minimize conflict - long corridors were not used and occupancies for living spaces allowed for democratic design-making. Safe cell design methods included specifying recessed and/or sloped hardware, designing lighting to be recessed and additional exhaust equipment for ventilation in case of fire and air circulation. An association is made between an inmate's ability to have privacy (locking bedroom doors) and lower rates of conflict between inmates and between inmates and staff.


Article Two
Violence in the Supermax : A Self-Fulfilling Prophecy
The author's point seems to be that supermax prisons, like Pelican Bay State Prison in California, create an environment that in no way rehabilitates prisoners but instead dehumanizes them such that they are less stable and possibly more violent than when they entered incarceration. Prison staff, policy, culture and design are all factors in the overall flawed system. Prisoners are isolated for up to 23 hours per day, provided little to no access to the outdoors and receive no mental or emotional care. Pelican Bay uses concrete, steel and plexiglas for cells, partitions and furniture. With little access to the natural environment most prisoners experience little to no daylight and overall poorly or overly-lit environments. Indoor air quality is questionable as recycled air is the only option. The article goes on to describe staff (correctional officer) training and the their sub-culture within the overall prison culture. Inmate subculture is also described. Other information is provided regarding prison policies and deductions made regarding the effects of solitary confinement and abusive treatment on the psychological state of inmates.


Analysis
For the purpose of my research I think it is helpful to isolate within these articles what I can tie directly to architectural design. With a topic like this there are so many factors to consider it can become difficult to asses causes and effects. Both of these articles describe specific architectural design elements like space planning, adjacencies and transitions, orientation to daylight, use of color and materials as interior materials and finishes, lighting and segregational versus congregational environments. My initial research topic was based on the relationship between prison architectural design and instances of violence between inmates or between inmates and correctional officers. As I read the above articles I question whether I want to open my research topic to explore links between design and violent instances, percentage of inmates receiving parole and percentage of inmates being treated for emotional issues. The difficulty is finding research that supports a direct link between the architecture of a prison and those three things. There are so many cultural factors like fear of abuse from other inmates and staff and prison policies that inform officers  to treat inmates as not worthy of humane conditions. I think studying the effects of the architectural elements I have described on inmate emotional or mental well-being will fall under the qualitative research and looking for numbers related to violence or treatment will align with more quantitative research.


Questions
Is there research available on indoor air quality in prisons and the relative health of inmates with varying levels of outdoor access?
What are differences in prison design today versus 10, 20, 30 years ago?
Does visual access to the outdoors but not to other inmates make a difference in the percentage of inmates in solitary confinement requiring cell extractions or medical care?
Would a more open plan design for prisons work the same way, policy-wise, as the labyrinth plan design currently used by most prisons?
How has technology affected prison design - in the supermax prison designs described in this article, almost 100% of the surveillance occurs through cameras and other electrical systems. Human interaction occurs very rarely yet inmates are aware they are never not being watched.


References

Grant, E. (2006). Mobilong Independent Living Units: New Innovations in Australian Prison Architecture. Corrections Today, 68(3), 58-61. 
King, K., Steiner, B., & Breach, S. (2008). Violence in the Supermax. Prison Journal, 88(1), 144-168. 

Friday, February 4, 2011

Two approaches : One problem

As an MFA candidate in the Interior Design department I'm in the process of developing a thesis project. One of the great things about having such a range of options available is the opportunity to explore new and totally unfamiliar topics. The challenge is that I'm completely bored by almost every topic I've put on paper, err, into cyber space. Why is it so difficult to come up with an original approach? For a supposedly creative individual, I've come up with a lot of hackneyed ideas. Therefore, I'm excited to use my Research Methods class to flush out topics related to my current ideas. I think by reading and analyzing existing work I just might learn more than enough to help me find a topic, and specifically an approach to that topic, that will lead to a thesis project concept.


Idea #1
The effect of incarceration facility interior design on the rehabilitation of an inmate.


Quantitative
The effect of square footage dedicated to communal spaces vs. square footage dedicated to isolation spaces on levels/rates of prison violence.


Qualitative
Perceived connection to the outside world vs. actual connection to the outside world .

The differences between these two approaches include the following:


The quantitative will look specifically at the connection between square footage distribution and violence levels. From these numbers and comparisons I will draw conclusions that are based on a small set of variables and allow little room for interpretation. Research will likely include reports from prisons including square footage and violent incidences.
The qualitative approach requires that I define "well-being" for the sake of this research. Based on that definition I will infer and asses whether connection to the world beyond the prison walls actually plays a role in their well-being. Research will likely include accounts from prison staff and prisoners regarding mental, emotional and physical health as related to isolation, visual access to the natural environment and access to the community surrounding the incarceration facility.