POLI 300: Advanced Quantitative Methods in the
Social Sciences
Spring Semester 2017
Room: Armacost 139
Mondays and Wednesdays from 11:00amÐ12:20pm
Professor Greg Thorson Office: Hall of Letters 306
Phone: (909)748-8636 Office Hours: Mondays (2:00pm -3:00pm),
Email: Greg_Thorson@redlands.edu Fridays (10:30am Ð 11:30am), and
Web Page: http://facweb1.redlands.edu/fac/Greg_Thorson/ by appointment
Course Description
Do you like to play with data? Do you like to manipulate datasets to test interesting social hypotheses? Are you interested in moving beyond the helpful, but sometime simplistic, methods that you learned in your introductory statistics class to more sophisticated quantitative methods? Do you want to be well-prepared for even the most quantitative graduate programs? If you answered ÒyesÓ to any of these questions, this class may be perfect for you!
The purpose of this course is to expose students to the most commonly used advanced statistical techniques used in the social sciences. After briefly reviewing the key concepts and procedures that you covered in your introductory statistics course (e.g. linear regression), we will move on to cover such advanced topics as fixed effects models, difference-in-difference models, two stage least squares, and time series analysis.
Each of these techniques will be explained both mathematically and conceptually. A strong command of math and calculus is NOT required for this class. Indeed, I welcome Òmath phobesÓ! Like most professional social scientists, we will rely heavily on statistical software (i.e. Stata) to do the mathematical computations for us, but we nevertheless will examine the formulas closely to better understand both the strengths and the weaknesses of specific quantitative methodologies. We will also closely examine the assumptions of each of these techniques.
Courses covering these advanced quantitative methods are rare in undergraduate programs. Up until just the past few years, most social scientists believed this content was far too difficult for undergraduates, but recent advances in statistical software, hardware computing capabilities, and finally in quality textbooks have made access to this material possible for undergraduates. My hope is to provide you with an outstanding experience in statistics that compares favorably with that of the highest quality undergraduate programs in the social sciences either nationally or internationally.
Course Prerequisite: Introductory course in statistics (preferably POLI 202)
Course Learning Outcomes
1) To review the foundations of quantitative analysis in the social sciences, including the principles of inferential statistics, hypothesis testing, and Ordinary Least Squares (OLS) regression.
2) To improve studentsÕ command of the programming language used in Stata, the leadings statistical software used in the social sciences.
3) To introduce students to such advanced quantitative statistical techniques such as fixed effects models, difference-in-difference models, two-stage least squares models, regression discontinuity analysis, and/or time series analysis.
4) To empower students to develop testable hypotheses seeking to explain (or predict) an important social phenomenon or problem, obtain a dataset of their choice from a major data consortium (ICPSR), run appropriate statistical analysis to test these hypotheses, and write up the results.
Required Texts
Bailey, Michael A. 2016. Real Stats: Using Econometrics for Political Science and Public
Policy. New York: Oxford University Press.
Paul, Richard and Linda Elder. 2014. Critical Thinking: Concepts and Tools (7th Edition).
Tomales, CA: Foundation for Critical Thinking.
Grades
Final grades for the course will be based on your performance in the following areas:
Daily Quizzes/Participation 35%
Assignments 20%
Current Research Studies 15%
Take-Home/Final Exam Paper 20%
Take-Home Final Exam Paper Presentation 10%
Extra Credit Up to 10%
Course grades will be assigned using the following guidelines:
Course Percent |
Grade |
93%-100% |
4.0 |
88%-93% |
3.7 |
83%-88% |
3.3 |
79%-83% |
3.0 |
75%-79% |
2.7 |
71%-75% |
2.3 |
67%-71% |
2.0 |
63%-67% |
1.7 |
60%-63% |
1.3 |
57%-60% |
1.0 |
54%-57% |
0.7 |
Below 54% |
0.0 |
Grading Scale
Check System (Assignments)
Grade |
Points |
Check |
10/10 |
Check Minus |
6/10 |
Zero |
0/10 |
Midterm Exam
The midterm exam will be closed book and closed note and will be composed of short answer and short essay questions. I will provide you with a review sheet to assist you in your preparation. The midterm exam will last 80 minutes.
Daily Quizzes/Participation
Students will be graded on their physical presence in class as well as their participation in class discussion. Students are required to have read the assigned material before coming to class. Your participation grade will be based on your physical presence in class, the quantity and quality of your contributions to the class discussion, and the extent and quality of your preparation for class as measured by your participation in class and daily class quizzes.
Class attendance, as well as taking the quizzes, is required for completion of the course. On the first day of class I will distribute ÒclickersÓ from Turning Technologies Audience Response System. Please note both the number of your clicker and the Device ID printed on the back of the clicker. You will be responsible for picking it up before and returning it after each class session.
You will take daily quizzes that ask you about a) the main points from the previous class discussion, and b) the major points addressed in the new readings to be discussed in class that day. This use of the clickers will reward you for both attending class and for being prepared for class each day.
I will provide you with a clicker (normally priced at $51) at no charge to you that you will use to take your quizzes daily. However, you will be responsible for both creating a Turning Account and paying the mandatory subscription fee (see below).
To create your mandatory Turning Account, go to:
https://account.turningtechnologies.com/account/
Please note that you will need to buy a license to use the software. Buying a bundle or clicker is NOT necessary. There are several options for purchasing a license (pricing subject to change):
One Year: $20.99
Two Years: $31.50
Three Years: $35.00
Four Years: $37.00
I am currently the only professor using TurningPoint Cloud at the University of Redlands. I currently use the clickers in all of my on-campus classes. If you anticipate taking additional classes from me in the future, you may want to buy an extended license.
You may pay for your license with Visa, MasterCard, American Express, or Discover.
After you have registered a license, go ahead and register your assigned device. Simply add the Device ID that is printed on back of the clicker that you were assigned in class.
The final step is to enroll in our class via Turning Technologies. From the Turning Dashboard, select Enroll from the menu bar on the left-hand side of the screen. Next youÕll see a search bar in the upper right hand corner of the screen. Click anywhere inside the bar and type my last name (Thorson). You will see all the classes that I teach. Click the box next to the course you are taking and click the green Enroll button. ThatÕs it!
Please complete this registration prior to the second day of class.
Make-up Quiz and Exam Policy
Make-up quizzes and exams are available only when a student has an instructor-approved reason for missing the regular quiz or exam (such as extra-curricular music or athletic events, doctorÕs note, etc.). Whenever possible, both notification and arrangements for the make-up exam must be made either before the missed quiz or exam. If you miss a class period for an approved reason, you may submit a one-page summary of the reading for that day within seven days of the missed class period to earn the missed quiz participation points.
Take-Home Final Exam/Paper
Each student is required to write a short 4+ page research paper that features a brief original data analysis. You may use any dataset of your choice, including those used in class or those that I help you to obtain. However, if you choose to use an external dataset (including one from the Inter-University Consortium for Political and Social Research (ICPSR)) that is not used in the class, you will receive a full letter grade of extra credit for your Take-Home Final Exam/Paper.
To obtain an ICPSR dataset, simply go to the LibraryÕs homepage at:
http://www.redlands.edu/library/index.aspx
Then select Article Databases in the left-hand box, and then click on the letter I to select ICPSR. Once at the ICPSR site, you will need to create a free MyData account. Simply click on the Log-in/Create Account link in the upper right hand corner of the ICPSR homepage.
After you have completed the signup process, you can now browse the ICPSR data holdings. You may browse recent additions to the database in the last 90 days, browse by subject matter, or search for specific datasets.
Many datasets are available in Stata format. Others require a bit of work. Please donÕt hesitate to ask for my help to access these datasets.
Many ICPSR datasets come with complete documentation, including codebooks. Codebooks describe the specific question that was asked, along with how each response was coded. Many codebooks also describe in detail how people were sampled. This information can be very helpful!
Although the paper should be written in a narrative format, consider including the following content (in this order):
1) A brief section describing the research problem and why it is important
2) A brief literature review: 3 sources minimum (Note: provide transitions between articles).
3) Statement of hypotheses, including rationales for why variables were selected
4) Description of dataset, measures, and coding (Make sure you clearly identify how each of the variables, both independent and dependent, are coded)
5) Empirical results and analysis (Note: number and label your tables)
6) Conclusions/Implications/Effect on Future Work
7) At least two appendices that include a) your Stata .do file and b) the frequencies with a value labels of all variables used in your analysis
To find suitable references, consider using Google Scholar, JSTOR, and other resources in the Armacost Library. When using Google Scholar and JSTOR, consider finding a classic article on the topic and clicking the ÒCited byÓ link.
Pay close attention to the quality of your sources. The strongest sources will be from top journals in Public Policy, Economics, and Political Science (e.g. Journal of Policy Analysis and Management, American Economic Journal of Applied Economics, American Economic Journal of Economic Policy, American Political Science Review, Journal of Politics, American Journal of Political Science, etc.) as well as books written from the top university presses (Cambridge, Michigan, Harvard, Yale, etc.).
Papers must be double-spaced and written in Microsoft Word format, with an 11-point font and 1Ó margins. Your bibliography and citations must use the adopted by the American Political Science Association. See http://www.apsanet.org/Portals/54/APSA%20Files/publications/APSAStyleManual2006.pdf for the complete style manual.
Please note that bibliographies do not count toward the 4-page minimum.
A hard copy of your paper must be submitted by the beginning of the final exam period (9am on Thursday, April 20th). Late papers will be penalized a full letter grade per calendar day. Students will make a formal PowerPoint presentation of their papers during the final exam period (9am Ð 11am) on Thursday, April 20th.
Presentation/PowerPoint Tips (see also Turabian, pp. 124-128):
1) Keep your presentation simple. Clearly and prominently present the thesis of your paper.
2) Discuss relevant research in detail, but keep track of your time.
3) Use high-quality graphics. Avoid ClipArt.
4) Use data and charts sparingly but effectively.
5) Limit the number of words and/or bullets on each slide.
6) DonÕt read the PowerPoint slides verbatim.
7) Leave at least three minutes at the end of the presentation for questions. Answer each question directly and clearly.
8) Practice in advance. Be sure to time yourself.
9) Turn in paper copies of your PowerPoint along with your other paper materials (e.g. prospectus, outline, peer review, faculty review, final draft) at the conclusion of your presentation.
Be sure to complete your paper on time. Late papers will be penalized a full letter grade per calendar day.
Students are also encouraged to take advantage of the writing assistance offered by Student Services.
Current Research Studies
One of the objectives of this course is to increase the statistical literacy of students in the class. I am particularly interested in having you improve your capacity to critique statistical studies and/or the presentation of statistical data that not only appear in public policy and political science journals, but in the mainstream media as well.
To help accomplish this objective, we will begin each class period by briefly offering a critique of some statistical analyses found in recent journals or the mainstream media. On your assigned days (see below), please bring to class a printed copy of some statistical analysis as described in the media (emails NOT accepted). Examples might include stories that summarize recent quantitative research studies, economic data, or even medical health studies. The content does not need to be political in nature. Print both your name and the date of the class period on the printed copy of the analysis and turn it in to me at the beginning of class. Please be prepared to critique the article with the help of your professor and your classmates. We will discuss both the strengths and weaknesses of the authorÕs analysis of the data in class each day.
Where can you find these analyses? Mainstream newspapers carry these stories each day. Some sources include the New York Times, the Los Angeles Times, the Washington Post, and the USA Today. Also of interest are local analyses that are published in the Riverside Press Enterprise or the Redlands Daily Facts. Try conducting internet news searches with terms such as ÒstudyÓ or Òresearch reportÓ.
I would like to review a few of these analyses each day. To effectively accomplish this task, students will be assigned into one of eight sections. Students are required to bring to class an example of one of these analyses on each of their assigned days.
Group 1: January 11, 30, February 13, March 6, 20, April 3
Group 2: January 16, February 1, 15, March 8, 22, April 5
Group 3: January 18, February 6, 20, March 13, 27, April 10
Group 4: January 25, February 8, 22, March 15, 29
Appropriate Use of Computers During Class
Students are strictly prohibited from using the computers for non-class use during our class session. Examples of prohibited activities include: web browsing, checking email, accessing Facebook, and/or Twitter, etc. You may use the computers for these purposes both before and after class, but not during class. Failure to abide by this policy may result in the reduction in the Class Participation section of your grade. Please note that I have the technological capability to view and display on the projector all your displays from my podium. J
Withdrawal/Incomplete:
Students are responsible for voluntarily withdrawing from the class should they decide not to complete it. If your name appears on the registrarÕs final grade sheet and I can find no work on which to base a grade, I must give you an ÒFÓ. I observe all University drop deadlines. In addition, no ÒincompleteÓ grades will be given except under extraordinary circumstances.
Accommodations for Students with Disabilities
I am happy to provide accommodations to students with disabilities. Please contact the University of Redlands Disability Services office to set up these arrangements. Disability Services can be reached at 748-8108. Disability Services has a highly trained staff that has the experience and expertise to assist students with a wide range of disabilities.
Academic Honesty:
Scholastic dishonesty means plagiarizing; cheating on assignments or examinations; engaging in unauthorized collaboration on academic work; taking, acquiring, or using test materials without faculty permission; submitting false or incomplete records of academic achievement; acting alone or in cooperation with another to falsify records or to obtain dishonestly grades, honors, awards, or professional endorsement; altering forging, or misusing a University academic record; or fabricating or falsifying data, research procedures, or data analysis. In this course, a student responsible for scholastic dishonesty can be assigned a penalty up to and including an "F" or "N" for the course.
You are responsible for both understanding and obeying both all departmental and University policies on academic honesty. Failure to obey these guidelines can result in both failure in the class and expulsion from the University.
Course Outline/Assignments (Please note this is a tentative schedule and may be adjusted at any time by the Professor):
January 9 Syllabus and Introductions
January 16 Good Data Practices
Bailey, Chapter 2
Exercises: Questions 1-2 (Due Next Class Period)
Extra Credit: Questions 3-4 (Due Next Class Period)
January 18 Bivariate Ordinary Least Squares (OLS) Regression
Exercises: Question 1 (Due January 25)
Extra Credit: Questions 2-5 (Due January 25)
January 23 In Class Exercise Day!
January 25 Using Statistics to Test Hypotheses
Bailey, Chapter 4
Exercises: Question 1 (Due Next Class Period)
Extra Credit: Questions 2-5 (Due Next Class Period)
January 30 Ð February 1 Multivariate OLS
Bailey, Chapter 5
Exercises: Question 1 (Due Next Class Period)
Extra Credit: Questions 2-5 (Due Next Class Period)
Exercises: Question 1 (Due Next Class Period)
Extra Credit: Questions 2-5 (Due Next Class Period)
February 8 Transforming Variables: Best Practices
Bailey, Chapter 7
Exercises: Question 1 (Due Next Class Period)
Extra Credit: Questions 2-5 (Due Next Class Period)
February 13-15 Fixed Effects and Difference in Difference Models
Bailey, Chapter 8, pp. 247-268
Exercises: Question 1 and 4 (Due Next Class Period)
Extra Credit: Questions 2-3, 5-6 (Due Next Class Period)
February 20-22 Two-Stage Least Squares
Bailey, Chapter 9
Exercises: Question 1 (Due Next Class Period)
Extra Credit: Questions 2-5 (Due Next Class Period)
February 27 - March 1 No Class - Spring Break
March 6-8 Regression Discontinuity Analysis
Bailey, Chapter 11
Exercises: Question 1 (Due Next Class Period)
Extra Credit: Questions 2-4 (Due Next Class Period)
March 13-15 Regression with Limited Dependent Variables
Bailey, Chapter 12
Exercises: Question 1 (Due Next Class Period)
Extra Credit: Questions 2-4 (Due Next Class Period)
March 20-22 Time Series Analysis
Bailey, Chapter 13
Exercises: Question 1 (Due Next Class Period)
Extra Credit: Questions 2-3 (Due Next Class Period)
March 27-29 Using Social Science Experiments in the Real World
Bailey, Chapter 10
Exercises: Question 1 (Due Next Class Period)
Extra Credit: Questions 2-4 (Due Next Class Period)
April 3-5 Advanced Panel Data
Bailey, Chapter 15
Exercises: Question 1 (Due Next Class Period)
Extra Credit: Question 2 (Due Next Class Period)
April 10 How to Be a Statistical Realist
Bailey, Chapter 16
April 12 Course Wrap-Up / Teaching Evaluations
April 20 (9am-11am) Take-Home/Final Exam Paper Due/Presentations!
Final Examination:
Consistent with
the universityÕs final exam policies, your paper will serve as the final exam
will be due at 9am on Thursday, April 20th . On that day, students
will briefly present their papers during the scheduled final exam period (9am
to 11am) or as directed by the DeanÕs Office. Please mark this final exam/paper
presentation date on your calendar ASAP. Do not plan to depart Redlands until
your paper and presentation are completed!
|
University of Redlands* Public Policy Program Effective Written Communication Rubric |
Student Learning Outcome:
Communicate knowledge effectively through verbal and written forms.
3=Advanced; 2=Proficient; 1=Basic; 0=Below Basic
Indicators of Effective Writing |
Levels of Achievement |
|||
Advanced (3) |
Proficient (2) |
Basic (1) |
Below Basic (0) |
|
Thesis/Research Question |
Easily identifiable, clear and concise, insightful, and appropriate for the field of Public Policy |
Identifiable, clear, and appropriate for the field |
Somewhat difficult to identify, unclear, and/or slightly inappropriate for the field |
Very difficult to identify, unclear, and/or inappropriate for the field |
Organization |
Coherent and clear, all paragraphs support thesis statement, each paragraph supports its topic sentence, excellent transitions |
Mostly coherent, generally supports thesis, good transitions |
Often lacks coherence, mixed support for thesis, transitions often missing or weak |
Incoherent, lacks support for thesis, transitions weak and often missing |
Analysis, Logic and Argumentation |
All ideas progress logically from an identifiable thesis, compelling justifications are offered to support thesis, counter-arguments are anticipated and addressed, appropriate connections are made to outside material |
Thesis is generally supported by logically compelling assertions and appropriate connections |
Insufficient support for some arguments, assertions are vague or lack focus, support offered is sometimes irrelevant, tangential or repetitive |
Lacks support for arguments, unfocused, uses irrelevant information to support thesis |
Use of Evidence |
Appropriate source information (typically primary) used to support thesis and buttress all arguments made in essay, excellent integration of quoted/paraphrased material into writing |
Appropriate source information used to support thesis and to buttress most arguments, good integration of sources into writing |
Sometimes weak use of source information (excessively secondary), inadequately supports thesis and/or sub-arguments, weak integration of quoted/paraphrased material into writing |
Very weak use of source information (excessively secondary), fails to support thesis and/or sub-arguments, very weak integration of material into writing |
Mechanics (Grammar, Spelling, Language Usage, Sentence Structure, Citation Format) |
Excellent command of language, proper use of grammar/writing conventions, few to no misspelled words, correct word choice, excellent variety and complexity of sentence structure, uses citation format appropriate to the field of Public Policy |
Good command of language, generally proper use of grammar/writing conventions, minimal misspelled words, largely good word choice, some variety and complexity in sentence structure, generally uses citation format appropriate to the field |
Generally proper use of grammar/writing conventions, but with simple sentences generally lacking variety/complexity in structure, acceptable citation format |
Weak use of language, poor grammar, and numerous mechanical errors undermine coherence, weak citation format |
* Special thanks to Fort Hays State University Department of Political Science for developing this framework.
|
University of Redlands* Public Policy Program Effective Oral Communication Rubric |
Student Learning Outcome:
Communicate knowledge effectively through verbal and written forms.
3=Advanced; 2=Proficient; 1=Basic; 0=Below Basic
Indicators of Effective Content |
Levels of Achievement |
|||
Advanced (3) |
Proficient (2) |
Basic (1) |
Below Basic (0) |
|
Indicators of Effective Content |
||||
Introduction: gains attention, connects to topic, establishes credibility |
Creative attention getting strategy captures listenersÕ attention to introduce the topic. It is relevant to the topic and clearly gains the desired response from the audience. Credibility was established by speaker. |
Effective strategy to capture listenersÕ attention. Adequate introduction of the topic. Credibility was established by the speaker. |
Use of attention getting strategy, but did not seem to adequately capture audience attention and/ or lead to desired outcome. Credibility was implied. |
No attention getting strategy was evident. No clear or relevant connection to topic or speech purpose. No credibility was established. |
Thesis Statement: explicit, identifies topic, previews main points |
Speaker clearly stated a well formulated thesis statement during the speech introduction. Thesis statement identifies topic and lists/previews main points. |
Thesis statement identifies topic and lists/previews main points. |
Thesis is implied, although not explicitly stated. Topic is clearly identified, but main points are not clearly previewed. |
No thesis statement. Main points are not clearly identified, audience unsure of the direction of the message. |
Connection to Audience: needs & interest, demonstrates understanding |
Connection of topic to audience needs and interests is stated with sophistication. Identifies and expresses a deep understanding of their target audience. |
Clearly stated the relevance of topic to audience needs and interests. Expresses an understanding of their target audience. |
Topic seems somewhat relevant to audience. Vague reference to audience needs and or interests. Identifies target audience. |
Topic seems irrelevant to audience needs and interests. No attempt made to connect topic to audience. |
Subject Knowledge: depth of content, relevant support, clear explanation |
Depth of content reflects thorough understanding of topic. Main points well supported with timely, relevant and sufficient support. Provided precise explanation of key concepts. |
Main points adequately substantiated with timely, relevant and sufficient support. Accurate explanation of key concepts. |
Provides some support for main points, but needed to elaborate further with explanations, examples, descriptions, etc. Support is relevant, but not timely. |
Provides irrelevant or no support. Explanation of concepts is inaccurate or incomplete. |
Organization: main points distinct from support, transitions, coherence |
Effective organization well suited to purpose. Main points are clearly distinct from supporting details. Graceful transitions create coherent progress toward conclusion. |
Clear organizational pattern. Main points are distinct from supporting details. Smooth transitions differentiate key points. |
General structure/organization seems adequate. Difference between main points and supporting details is blurred. Logical flow, but no clear signposts for transitions. |
Lack of structure. Ideas are not coherent. No transitions. Difficult to identify introduction, body, and conclusion. |
Indicators of Effective Delivery |
||||
Eye Contact: establish rapport; expand zone of interaction |
Consistently uses eye contact to maintain rapport with audience. Inconspicuous use of speaker notes. Effective use of scanning to expand zone of interaction. |
Eye contact establishes rapport with audience. Unobtrusive use of speaker notes. Scanning of audience to establish a zone of interaction. |
Conspicuous use of speaker notes. Only occasional, sporadic glances at audience. |
Reads speech from notes/manuscript. Avoids eye contact with audience. |
Movement: expressive, comfortable, enhances message |
Gestures, facial expressions, and posture reinforce and enhance the verbal message. Body language is expressive, dynamic, natural and comfortable. |
Body language is an adequate support of the message. Movement and gestures clarify key points. Facial expressions and posture seem comfortable. |
Body language is a minimal support of the verbal message. Gestures, facial expressions, and posture reflect speaker discomfort that occasionally interferes with the message. |
Body language is not supportive of the message, may contradict it. Gestures, facial expressions, and posture are stiff or distracting. |
Voice: rate, pitch, volume and tone are natural and authentic |
Tone is authentic and appropriate to topic. Rate, pitch and volume vary at key points to support the verbal message and keep audience interest. Voice is natural to the speaker and topic, talking with rather than at audience. |
Tone fits verbal message, changing for emphasis at appropriate moments. Rate and volume allow audience to follow message. Pitch seems natural to speaker. |
Inconsistent use of voice to support message. Monotone passages interfere with audience interest. Rate may be too fast or slow; volume too high or low. Pitch is strained at times, too artificial or too nervous. |
Fails to maintain audience interest and support the verbal message due to excessive monotone, inappropriate rate and volume. Pitch may be strained or flat. |
Fluency: pronunciation, enunciation, articulation are smooth; lack of fillers |
Coherence of presentation strongly supported by correct pronunciation, confident enunciation and articulation. Pauses are purposeful and enhance fluency of speech. Virtually no vocalized fillers are noticeable. |
Careful pronunciation supports coherence of presentation. Enunciation and articulation of words are mostly clear. Pauses were momentary and did not interrupt fluency of speech. Vocalized fillers are minimal and do not distract the audience. |
Pronunciation is mostly correct yet enunciation and articulation are still tentative. Speaker recovers from awkward pauses and proceeds. Vocalized fillers are noticeable but not excessive. |
Coherence of presentation strongly supported by correct pronunciation, confident enunciation and articulation. Pauses are purposeful and enhance fluency of speech. Virtually no vocalized fillers are noticeable. |
*Special thanks to Valencia Community College for developing this framework.