quantitative research methodology example

Research Methodologies

Quantitative research methodologies.

• Qualitative Research Methodologies
• Systematic Reviews
• Finding Articles by Methodology
• Design Your Research Project

Library Help

What is quantitative research.

Quantitative methodologies use statistics to analyze numerical data gathered by researchers to answer their research questions. Quantitative methods can be used to answer questions such as:

• What are the relationships between two or more variables? 
• What factors are at play in an environment that might affect the behavior or development of the organisms in that environment?

Quantitative methods can also be used to test hypotheses by conducting quasi-experimental studies or designing experiments.

Independent and Dependent Variables

In quantitative research, a variable is something (an intervention technique, a pharmaceutical, a temperature, etc.) that changes. There are two kinds of variables:  independent variables and dependent variables . In the simplest terms, the independent variable is whatever the researchers are using to attempt to make a change in their dependent variable.

* This is a real, repeatable experiment you can try on your plants.

Correlational

Researchers will compare two sets of numbers to try and identify a relationship (if any) between two things.

• Köse S., & Murat, M. (2021). Examination of the relationship between smartphone addiction and cyberchondria in adolescents. Archives of Psychiatric Nursing, 35(6): 563-570.
• Pilger et al. (2021). Spiritual well-being, religious/spiritual coping and quality of life among the elderly undergoing hemodialysis: a correlational study. Journal of Religion, Spirituality & Aging, 33(1): 2-15.

Descriptive

Researchers will attempt to quantify a variety of factors at play as they study a particular type of phenomenon or action. For example, researchers might use a descriptive methodology to understand the effects of climate change on the life cycle of a plant or animal. 

• Lakshmi, E. (2021). Food consumption pattern and body mass index of adolescents: A descriptive study. International Journal of Nutrition, Pharmacology, Neurological Diseases, 11(4), 293–297.
• Lin, J., Singh, S., Sha, L., Tan, W., Lang, D., Gašević, D., & Chen, G. (2022). Is it a good move? Mining effective tutoring strategies from human–human tutorial dialogues. Future Generation Computer Systems, 127, 194–207.

Experimental

To understand the effects of a variable, researchers will design an experiment where they can control as many factors as possible. This can involve creating control and experimental groups. The experimental group will be exposed to the variable to study its effects. The control group provides data about what happens when the variable is absent. For example, in a study about online teaching, the control group might receive traditional face-to-face instruction while the experimental group would receive their instruction virtually. 

• Jinzhang Jia, Yinuo Chen, Guangbo Che, Jinchao Zhu, Fengxiao Wang, & Peng Jia. (2021). Experimental study on the explosion characteristics of hydrogen-methane premixed gas in complex pipe networks. Scientific Reports, 11(1), 1–11.
• Sasaki, R. et al. (2021). Effects of cryotherapy applied at different temperatures on inflammatory pain during the acute phase of arthritis in rats. Physical Therapy, 101(2), 1–9.

Quasi-Experimental/Quasi-Comparative

Researchers will attempt to determine what (if any) effect a variable can have. These studies may have multiple independent variables (causes) and multiple dependent variables (effects), but this can complicate researchers' efforts to find out if A can cause B or if X, Y,  and  Z are also playing a role.

• Jafari, A., Alami, A., Charoghchian, E., Delshad Noghabi, A., & Nejatian, M. (2021). The impact of effective communication skills training on the status of marital burnout among married women. BMC Women’s Health, 21(1), 1-10.
• Phillips, S. W., Kim, D.-Y., Sobol, J. J., & Gayadeen, S. M. (2021). Total recall?: A quasi-experimental study of officer’s recollection in shoot - don’t shoot simulators. Police Practice and Research, 22(3), 1229–1240.

Surveys can be considered a quantitative methodology if the researchers require their respondents to choose from pre-determined responses. 

• Harries et al. (2021). Effects of the COVID-19 pandemic on medical students: A multicenter quantitative study. BMC Medical Education, 21(14), 1-8.
• Call : 801.863.8840
• Text : 801.290.8123
• In-Person Help
• Email a Librarian
• Make an Appointment
• << Previous: Home
• Next: Qualitative Research Methodologies >>
• Last Updated: Apr 25, 2024 2:32 PM
• URL: https://uvu.libguides.com/methods

• Skip to main content
• Skip to primary sidebar
• Skip to footer
• QuestionPro

• Solutions Industries Gaming Automotive Sports and events Education Government Travel & Hospitality Financial Services Healthcare Cannabis Technology Use Case NPS+ Communities Audience Contactless surveys Mobile LivePolls Member Experience GDPR Positive People Science 360 Feedback Surveys
• Resources Blog eBooks Survey Templates Case Studies Training Help center

Home Market Research

Quantitative Research: What It Is, Practices & Methods

Quantitative research involves analyzing and gathering numerical data to uncover trends, calculate averages, evaluate relationships, and derive overarching insights. It’s used in various fields, including the natural and social sciences. Quantitative data analysis employs statistical techniques for processing and interpreting numeric data.

Research designs in the quantitative realm outline how data will be collected and analyzed with methods like experiments and surveys. Qualitative methods complement quantitative research by focusing on non-numerical data, adding depth to understanding. Data collection methods can be qualitative or quantitative, depending on research goals. Researchers often use a combination of both approaches to gain a comprehensive understanding of phenomena.

What is Quantitative Research?

Quantitative research is a systematic investigation of phenomena by gathering quantifiable data and performing statistical, mathematical, or computational techniques. Quantitative research collects statistically significant information from existing and potential customers using sampling methods and sending out online surveys , online polls , and questionnaires , for example.

One of the main characteristics of this type of research is that the results can be depicted in numerical form. After carefully collecting structured observations and understanding these numbers, it’s possible to predict the future of a product or service, establish causal relationships or Causal Research , and make changes accordingly. Quantitative research primarily centers on the analysis of numerical data and utilizes inferential statistics to derive conclusions that can be extrapolated to the broader population.

An example of a quantitative research study is the survey conducted to understand how long a doctor takes to tend to a patient when the patient walks into the hospital. A patient satisfaction survey can be administered to ask questions like how long a doctor takes to see a patient, how often a patient walks into a hospital, and other such questions, which are dependent variables in the research. This kind of research method is often employed in the social sciences, and it involves using mathematical frameworks and theories to effectively present data, ensuring that the results are logical, statistically sound, and unbiased.

Data collection in quantitative research uses a structured method and is typically conducted on larger samples representing the entire population. Researchers use quantitative methods to collect numerical data, which is then subjected to statistical analysis to determine statistically significant findings. This approach is valuable in both experimental research and social research, as it helps in making informed decisions and drawing reliable conclusions based on quantitative data.

Quantitative Research Characteristics

Quantitative research has several unique characteristics that make it well-suited for specific projects. Let’s explore the most crucial of these characteristics so that you can consider them when planning your next research project:

• Structured tools: Quantitative research relies on structured tools such as surveys, polls, or questionnaires to gather quantitative data . Using such structured methods helps collect in-depth and actionable numerical data from the survey respondents, making it easier to perform data analysis.
• Sample size: Quantitative research is conducted on a significant sample size  representing the target market . Appropriate Survey Sampling methods, a fundamental aspect of quantitative research methods, must be employed when deriving the sample to fortify the research objective and ensure the reliability of the results.
• Close-ended questions: Closed-ended questions , specifically designed to align with the research objectives, are a cornerstone of quantitative research. These questions facilitate the collection of quantitative data and are extensively used in data collection processes.
• Prior studies: Before collecting feedback from respondents, researchers often delve into previous studies related to the research topic. This preliminary research helps frame the study effectively and ensures the data collection process is well-informed.
• Quantitative data: Typically, quantitative data is represented using tables, charts, graphs, or other numerical forms. This visual representation aids in understanding the collected data and is essential for rigorous data analysis, a key component of quantitative research methods.
• Generalization of results: One of the strengths of quantitative research is its ability to generalize results to the entire population. It means that the findings derived from a sample can be extrapolated to make informed decisions and take appropriate actions for improvement based on numerical data analysis.

Quantitative Research Methods

Quantitative research methods are systematic approaches used to gather and analyze numerical data to understand and draw conclusions about a phenomenon or population. Here are the quantitative research methods:

• Primary quantitative research methods
• Secondary quantitative research methods

Primary Quantitative Research Methods

Primary quantitative research is the most widely used method of conducting market research. The distinct feature of primary research is that the researcher focuses on collecting data directly rather than depending on data collected from previously done research. Primary quantitative research design can be broken down into three further distinctive tracks and the process flow. They are:

A. Techniques and Types of Studies

There are multiple types of primary quantitative research. They can be distinguished into the four following distinctive methods, which are:

01. Survey Research

Survey Research is fundamental for all quantitative outcome research methodologies and studies. Surveys are used to ask questions to a sample of respondents, using various types such as online polls, online surveys, paper questionnaires, web-intercept surveys , etc. Every small and big organization intends to understand what their customers think about their products and services, how well new features are faring in the market, and other such details.

By conducting survey research, an organization can ask multiple survey questions , collect data from a pool of customers, and analyze this collected data to produce numerical results. It is the first step towards collecting data for any research. You can use single ease questions . A single-ease question is a straightforward query that elicits a concise and uncomplicated response.

This type of research can be conducted with a specific target audience group and also can be conducted across multiple groups along with comparative analysis . A prerequisite for this type of research is that the sample of respondents must have randomly selected members. This way, a researcher can easily maintain the accuracy of the obtained results as a huge variety of respondents will be addressed using random selection. 

Traditionally, survey research was conducted face-to-face or via phone calls. Still, with the progress made by online mediums such as email or social media, survey research has also spread to online mediums.There are two types of surveys , either of which can be chosen based on the time in hand and the kind of data required:

Cross-sectional surveys: Cross-sectional surveys are observational surveys conducted in situations where the researcher intends to collect data from a sample of the target population at a given point in time. Researchers can evaluate various variables at a particular time. Data gathered using this type of survey is from people who depict similarity in all variables except the variables which are considered for research . Throughout the survey, this one variable will stay constant.

• Cross-sectional surveys are popular with retail, SMEs, and healthcare industries. Information is garnered without modifying any parameters in the variable ecosystem.
• Multiple samples can be analyzed and compared using a cross-sectional survey research method.
• Multiple variables can be evaluated using this type of survey research.
• The only disadvantage of cross-sectional surveys is that the cause-effect relationship of variables cannot be established as it usually evaluates variables at a particular time and not across a continuous time frame.

Longitudinal surveys: Longitudinal surveys are also observational surveys , but unlike cross-sectional surveys, longitudinal surveys are conducted across various time durations to observe a change in respondent behavior and thought processes. This time can be days, months, years, or even decades. For instance, a researcher planning to analyze the change in buying habits of teenagers over 5 years will conduct longitudinal surveys.

• In cross-sectional surveys, the same variables were evaluated at a given time, and in longitudinal surveys, different variables can be analyzed at different intervals.
• Longitudinal surveys are extensively used in the field of medicine and applied sciences. Apart from these two fields, they are also used to observe a change in the market trend analysis , analyze customer satisfaction, or gain feedback on products/services.
• In situations where the sequence of events is highly essential, longitudinal surveys are used.
• Researchers say that when research subjects need to be thoroughly inspected before concluding, they rely on longitudinal surveys.

02. Correlational Research

A comparison between two entities is invariable. Correlation research is conducted to establish a relationship between two closely-knit entities and how one impacts the other, and what changes are eventually observed. This research method is carried out to give value to naturally occurring relationships, and a minimum of two different groups are required to conduct this quantitative research method successfully. Without assuming various aspects, a relationship between two groups or entities must be established.

Researchers use this quantitative research design to correlate two or more variables using mathematical analysis methods. Patterns, relationships, and trends between variables are concluded as they exist in their original setup. The impact of one of these variables on the other is observed, along with how it changes the relationship between the two variables. Researchers tend to manipulate one of the variables to attain the desired results.

Ideally, it is advised not to make conclusions merely based on correlational research. This is because it is not mandatory that if two variables are in sync that they are interrelated.

Example of Correlational Research Questions :

• The relationship between stress and depression.
• The equation between fame and money.
• The relation between activities in a third-grade class and its students.

03. Causal-comparative Research

This research method mainly depends on the factor of comparison. Also called quasi-experimental research , this quantitative research method is used by researchers to conclude the cause-effect equation between two or more variables, where one variable is dependent on the other independent variable. The independent variable is established but not manipulated, and its impact on the dependent variable is observed. These variables or groups must be formed as they exist in the natural setup. As the dependent and independent variables will always exist in a group, it is advised that the conclusions are carefully established by keeping all the factors in mind.

Causal-comparative research is not restricted to the statistical analysis of two variables but extends to analyzing how various variables or groups change under the influence of the same changes. This research is conducted irrespective of the type of relationship that exists between two or more variables. Statistical analysis plan is used to present the outcome using this quantitative research method.

Example of Causal-Comparative Research Questions:

• The impact of drugs on a teenager. The effect of good education on a freshman. The effect of substantial food provision in the villages of Africa.

04. Experimental Research

Also known as true experimentation, this research method relies on a theory. As the name suggests, experimental research is usually based on one or more theories. This theory has yet to be proven before and is merely a supposition. In experimental research, an analysis is done around proving or disproving the statement. This research method is used in natural sciences. Traditional research methods are more effective than modern techniques.

There can be multiple theories in experimental research. A theory is a statement that can be verified or refuted.

After establishing the statement, efforts are made to understand whether it is valid or invalid. This quantitative research method is mainly used in natural or social sciences as various statements must be proved right or wrong.

• Traditional research methods are more effective than modern techniques.
• Systematic teaching schedules help children who struggle to cope with the course.
• It is a boon to have responsible nursing staff for ailing parents.

B. Data Collection Methodologies

The second major step in primary quantitative research is data collection. Data collection can be divided into sampling methods and data collection using surveys and polls.

01. Data Collection Methodologies: Sampling Methods

There are two main sampling methods for quantitative research: Probability and Non-probability sampling .

Probability sampling: A theory of probability is used to filter individuals from a population and create samples in probability sampling . Participants of a sample are chosen by random selection processes. Each target audience member has an equal opportunity to be selected in the sample.

There are four main types of probability sampling:

• Simple random sampling: As the name indicates, simple random sampling is nothing but a random selection of elements for a sample. This sampling technique is implemented where the target population is considerably large.
• Stratified random sampling: In the stratified random sampling method , a large population is divided into groups (strata), and members of a sample are chosen randomly from these strata. The various segregated strata should ideally not overlap one another.
• Cluster sampling: Cluster sampling is a probability sampling method using which the main segment is divided into clusters, usually using geographic segmentation and demographic segmentation parameters.
• Systematic sampling: Systematic sampling is a technique where the starting point of the sample is chosen randomly, and all the other elements are chosen using a fixed interval. This interval is calculated by dividing the population size by the target sample size.

Non-probability sampling: Non-probability sampling is where the researcher’s knowledge and experience are used to create samples. Because of the researcher’s involvement, not all the target population members have an equal probability of being selected to be a part of a sample.

There are five non-probability sampling models:

• Convenience sampling: In convenience sampling , elements of a sample are chosen only due to one prime reason: their proximity to the researcher. These samples are quick and easy to implement as there is no other parameter of selection involved.
• Consecutive sampling: Consecutive sampling is quite similar to convenience sampling, except for the fact that researchers can choose a single element or a group of samples and conduct research consecutively over a significant period and then perform the same process with other samples.
• Quota sampling: Using quota sampling , researchers can select elements using their knowledge of target traits and personalities to form strata. Members of various strata can then be chosen to be a part of the sample as per the researcher’s understanding.
• Snowball sampling: Snowball sampling is conducted with target audiences who are difficult to contact and get information. It is popular in cases where the target audience for analysis research is rare to put together.
• Judgmental sampling: Judgmental sampling is a non-probability sampling method where samples are created only based on the researcher’s experience and research skill .

02. Data collection methodologies: Using surveys & polls

Once the sample is determined, then either surveys or polls can be distributed to collect the data for quantitative research.

Using surveys for primary quantitative research

A survey is defined as a research method used for collecting data from a pre-defined group of respondents to gain information and insights on various topics of interest. The ease of survey distribution and the wide number of people it can reach depending on the research time and objective makes it one of the most important aspects of conducting quantitative research.

Fundamental levels of measurement – nominal, ordinal, interval, and ratio scales

Four measurement scales are fundamental to creating a multiple-choice question in a survey. They are nominal, ordinal, interval, and ratio measurement scales without the fundamentals of which no multiple-choice questions can be created. Hence, it is crucial to understand these measurement levels to develop a robust survey.

Use of different question types

To conduct quantitative research, close-ended questions must be used in a survey. They can be a mix of multiple question types, including multiple-choice questions like semantic differential scale questions , rating scale questions , etc.

Survey Distribution and Survey Data Collection

In the above, we have seen the process of building a survey along with the research design to conduct primary quantitative research. Survey distribution to collect data is the other important aspect of the survey process. There are different ways of survey distribution. Some of the most commonly used methods are:

• Email: Sending a survey via email is the most widely used and effective survey distribution method. This method’s response rate is high because the respondents know your brand. You can use the QuestionPro email management feature to send out and collect survey responses.
• Buy respondents: Another effective way to distribute a survey and conduct primary quantitative research is to use a sample. Since the respondents are knowledgeable and are on the panel by their own will, responses are much higher.
• Embed survey on a website: Embedding a survey on a website increases a high number of responses as the respondent is already in close proximity to the brand when the survey pops up.
• Social distribution: Using social media to distribute the survey aids in collecting a higher number of responses from the people that are aware of the brand.
• QR code: QuestionPro QR codes store the URL for the survey. You can print/publish this code in magazines, signs, business cards, or on just about any object/medium.
• SMS survey: The SMS survey is a quick and time-effective way to collect a high number of responses.
• Offline Survey App: The QuestionPro App allows users to circulate surveys quickly, and the responses can be collected both online and offline.

Survey example

An example of a survey is a short customer satisfaction (CSAT) survey that can quickly be built and deployed to collect feedback about what the customer thinks about a brand and how satisfied and referenceable the brand is.

Using polls for primary quantitative research

Polls are a method to collect feedback using close-ended questions from a sample. The most commonly used types of polls are election polls and exit polls . Both of these are used to collect data from a large sample size but using basic question types like multiple-choice questions.

C. Data Analysis Techniques

The third aspect of primary quantitative research design is data analysis . After collecting raw data, there must be an analysis of this data to derive statistical inferences from this research. It is important to relate the results to the research objective and establish the statistical relevance of the results.

Remember to consider aspects of research that were not considered for the data collection process and report the difference between what was planned vs. what was actually executed.

It is then required to select precise Statistical Analysis Methods , such as SWOT, Conjoint, Cross-tabulation, etc., to analyze the quantitative data.

• SWOT analysis: SWOT Analysis stands for the acronym of Strengths, Weaknesses, Opportunities, and Threat analysis. Organizations use this statistical analysis technique to evaluate their performance internally and externally to develop effective strategies for improvement.
• Conjoint Analysis: Conjoint Analysis is a market analysis method to learn how individuals make complicated purchasing decisions. Trade-offs are involved in an individual’s daily activities, and these reflect their ability to decide from a complex list of product/service options.
• Cross-tabulation: Cross-tabulation is one of the preliminary statistical market analysis methods which establishes relationships, patterns, and trends within the various parameters of the research study.
• TURF Analysis: TURF Analysis , an acronym for Totally Unduplicated Reach and Frequency Analysis, is executed in situations where the reach of a favorable communication source is to be analyzed along with the frequency of this communication. It is used for understanding the potential of a target market.

Inferential statistics methods such as confidence interval, the margin of error, etc., can then be used to provide results.

Secondary Quantitative Research Methods

Secondary quantitative research or desk research is a research method that involves using already existing data or secondary data. Existing data is summarized and collated to increase the overall effectiveness of the research.

This research method involves collecting quantitative data from existing data sources like the internet, government resources, libraries, research reports, etc. Secondary quantitative research helps to validate the data collected from primary quantitative research and aid in strengthening or proving, or disproving previously collected data.

The following are five popularly used secondary quantitative research methods:

• Data available on the internet: With the high penetration of the internet and mobile devices, it has become increasingly easy to conduct quantitative research using the internet. Information about most research topics is available online, and this aids in boosting the validity of primary quantitative data.
• Government and non-government sources: Secondary quantitative research can also be conducted with the help of government and non-government sources that deal with market research reports. This data is highly reliable and in-depth and hence, can be used to increase the validity of quantitative research design.
• Public libraries: Now a sparingly used method of conducting quantitative research, it is still a reliable source of information, though. Public libraries have copies of important research that was conducted earlier. They are a storehouse of valuable information and documents from which information can be extracted.
• Educational institutions: Educational institutions conduct in-depth research on multiple topics, and hence, the reports that they publish are an important source of validation in quantitative research.
• Commercial information sources: Local newspapers, journals, magazines, radio, and TV stations are great sources to obtain data for secondary quantitative research. These commercial information sources have in-depth, first-hand information on market research, demographic segmentation, and similar subjects.

Quantitative Research Examples

Some examples of quantitative research are:

• A customer satisfaction template can be used if any organization would like to conduct a customer satisfaction (CSAT) survey . Through this kind of survey, an organization can collect quantitative data and metrics on the goodwill of the brand or organization in the customer’s mind based on multiple parameters such as product quality, pricing, customer experience, etc. This data can be collected by asking a net promoter score (NPS) question , matrix table questions, etc. that provide data in the form of numbers that can be analyzed and worked upon.
• Another example of quantitative research is an organization that conducts an event, collecting feedback from attendees about the value they see from the event. By using an event survey , the organization can collect actionable feedback about the satisfaction levels of customers during various phases of the event such as the sales, pre and post-event, the likelihood of recommending the organization to their friends and colleagues, hotel preferences for the future events and other such questions.

What are the Advantages of Quantitative Research?

There are many advantages to quantitative research. Some of the major advantages of why researchers use this method in market research are:

Collect Reliable and Accurate Data:

Quantitative research is a powerful method for collecting reliable and accurate quantitative data. Since data is collected, analyzed, and presented in numbers, the results obtained are incredibly reliable and objective. Numbers do not lie and offer an honest and precise picture of the conducted research without discrepancies. In situations where a researcher aims to eliminate bias and predict potential conflicts, quantitative research is the method of choice.

Quick Data Collection:

Quantitative research involves studying a group of people representing a larger population. Researchers use a survey or another quantitative research method to efficiently gather information from these participants, making the process of analyzing the data and identifying patterns faster and more manageable through the use of statistical analysis. This advantage makes quantitative research an attractive option for projects with time constraints.

Wider Scope of Data Analysis:

Quantitative research, thanks to its utilization of statistical methods, offers an extensive range of data collection and analysis. Researchers can delve into a broader spectrum of variables and relationships within the data, enabling a more thorough comprehension of the subject under investigation. This expanded scope is precious when dealing with complex research questions that require in-depth numerical analysis.

Eliminate Bias:

One of the significant advantages of quantitative research is its ability to eliminate bias. This research method leaves no room for personal comments or the biasing of results, as the findings are presented in numerical form. This objectivity makes the results fair and reliable in most cases, reducing the potential for researcher bias or subjectivity.

In summary, quantitative research involves collecting, analyzing, and presenting quantitative data using statistical analysis. It offers numerous advantages, including the collection of reliable and accurate data, quick data collection, a broader scope of data analysis, and the elimination of bias, making it a valuable approach in the field of research. When considering the benefits of quantitative research, it’s essential to recognize its strengths in contrast to qualitative methods and its role in collecting and analyzing numerical data for a more comprehensive understanding of research topics.

Best Practices to Conduct Quantitative Research

Here are some best practices for conducting quantitative research:

• Differentiate between quantitative and qualitative: Understand the difference between the two methodologies and apply the one that suits your needs best.
• Choose a suitable sample size: Ensure that you have a sample representative of your population and large enough to be statistically weighty.
• Keep your research goals clear and concise: Know your research goals before you begin data collection to ensure you collect the right amount and the right quantity of data.
• Keep the questions simple: Remember that you will be reaching out to a demographically wide audience. Pose simple questions for your respondents to understand easily.

Quantitative Research vs Qualitative Research

Quantitative research and qualitative research are two distinct approaches to conducting research, each with its own set of methods and objectives. Here’s a comparison of the two:

Quantitative Research

• Objective: The primary goal of quantitative research is to quantify and measure phenomena by collecting numerical data. It aims to test hypotheses, establish patterns, and generalize findings to a larger population.
• Data Collection: Quantitative research employs systematic and standardized approaches for data collection, including techniques like surveys, experiments, and observations that involve predefined variables. It is often collected from a large and representative sample.
• Data Analysis: Data is analyzed using statistical techniques, such as descriptive statistics, inferential statistics, and mathematical modeling. Researchers use statistical tests to draw conclusions and make generalizations based on numerical data.
• Sample Size: Quantitative research often involves larger sample sizes to ensure statistical significance and generalizability.
• Results: The results are typically presented in tables, charts, and statistical summaries, making them highly structured and objective.
• Generalizability: Researchers intentionally structure quantitative research to generate outcomes that can be helpful to a larger population, and they frequently seek to establish causative connections.
• Emphasis on Objectivity: Researchers aim to minimize bias and subjectivity, focusing on replicable and objective findings.

Qualitative Research

• Objective: Qualitative research seeks to gain a deeper understanding of the underlying motivations, behaviors, and experiences of individuals or groups. It explores the context and meaning of phenomena.
• Data Collection: Qualitative research employs adaptable and open-ended techniques for data collection, including methods like interviews, focus groups, observations, and content analysis. It allows participants to express their perspectives in their own words.
• Data Analysis: Data is analyzed through thematic analysis, content analysis, or grounded theory. Researchers focus on identifying patterns, themes, and insights in the data.
• Sample Size: Qualitative research typically involves smaller sample sizes due to the in-depth nature of data collection and analysis.
• Results: Findings are presented in narrative form, often in the participants’ own words. Results are subjective, context-dependent, and provide rich, detailed descriptions.
• Generalizability: Qualitative research does not aim for broad generalizability but focuses on in-depth exploration within a specific context. It provides a detailed understanding of a particular group or situation.
• Emphasis on Subjectivity: Researchers acknowledge the role of subjectivity and the researcher’s influence on the Research Process . Participant perspectives and experiences are central to the findings.

Researchers choose between quantitative and qualitative research methods based on their research objectives and the nature of the research question. Each approach has its advantages and drawbacks, and the decision between them hinges on the particular research objectives and the data needed to address research inquiries effectively.

Quantitative research is a structured way of collecting and analyzing data from various sources. Its purpose is to quantify the problem and understand its extent, seeking results that someone can project to a larger population.

Companies that use quantitative rather than qualitative research typically aim to measure magnitudes and seek objectively interpreted statistical results. So if you want to obtain quantitative data that helps you define the structured cause-and-effect relationship between the research problem and the factors, you should opt for this type of research.

At QuestionPro , we have various Best Data Collection Tools and features to conduct investigations of this type. You can create questionnaires and distribute them through our various methods. We also have sample services or various questions to guarantee the success of your study and the quality of the collected data.

Quantitative research is a systematic and structured approach to studying phenomena that involves the collection of measurable data and the application of statistical, mathematical, or computational techniques for analysis.

Quantitative research is characterized by structured tools like surveys, substantial sample sizes, closed-ended questions, reliance on prior studies, data presented numerically, and the ability to generalize findings to the broader population.

The two main methods of quantitative research are Primary quantitative research methods, involving data collection directly from sources, and Secondary quantitative research methods, which utilize existing data for analysis.

1.Surveying to measure employee engagement with numerical rating scales. 2.Analyzing sales data to identify trends in product demand and market share. 4.Examining test scores to assess the impact of a new teaching method on student performance. 4.Using website analytics to track user behavior and conversion rates for an online store.

1.Differentiate between quantitative and qualitative approaches. 2.Choose a representative sample size. 3.Define clear research goals before data collection. 4.Use simple and easily understandable survey questions.

MORE LIKE THIS

Best 7 Gap Analysis Tools to Empower Your Business

Apr 25, 2024

12 Best Employee Survey Tools for Organizational Excellence

Customer Experience Management Platform: Software & Practices

Apr 24, 2024

eNPS Survey Software: Revolutionizing Workplace Dynamics

Other categories.

• Academic Research
• Artificial Intelligence
• Assessments
• Brand Awareness
• Case Studies
• Communities
• Consumer Insights
• Customer effort score
• Customer Engagement
• Customer Experience
• Customer Loyalty
• Customer Research
• Customer Satisfaction
• Employee Benefits
• Employee Engagement
• Employee Retention
• Friday Five
• General Data Protection Regulation
• Insights Hub
• Life@QuestionPro
• Market Research
• Mobile diaries
• Mobile Surveys
• New Features
• Online Communities
• Question Types
• Questionnaire
• QuestionPro Products
• Release Notes
• Research Tools and Apps
• Revenue at Risk
• Survey Templates
• Training Tips
• Uncategorized
• Video Learning Series
• What’s Coming Up
• Workforce Intelligence

Have a language expert improve your writing

Run a free plagiarism check in 10 minutes, automatically generate references for free.

• Knowledge Base
• Methodology
• What Is Quantitative Research? | Definition & Methods

What Is Quantitative Research? | Definition & Methods

Published on 4 April 2022 by Pritha Bhandari . Revised on 10 October 2022.

Quantitative research is the process of collecting and analysing numerical data. It can be used to find patterns and averages, make predictions, test causal relationships, and generalise results to wider populations.

Quantitative research is the opposite of qualitative research , which involves collecting and analysing non-numerical data (e.g. text, video, or audio).

Quantitative research is widely used in the natural and social sciences: biology, chemistry, psychology, economics, sociology, marketing, etc.

• What is the demographic makeup of Singapore in 2020?
• How has the average temperature changed globally over the last century?
• Does environmental pollution affect the prevalence of honey bees?
• Does working from home increase productivity for people with long commutes?

Table of contents

Quantitative research methods, quantitative data analysis, advantages of quantitative research, disadvantages of quantitative research, frequently asked questions about quantitative research.

You can use quantitative research methods for descriptive, correlational or experimental research.

• In descriptive research , you simply seek an overall summary of your study variables.
• In correlational research , you investigate relationships between your study variables.
• In experimental research , you systematically examine whether there is a cause-and-effect relationship between variables.

Correlational and experimental research can both be used to formally test hypotheses , or predictions, using statistics. The results may be generalised to broader populations based on the sampling method used.

To collect quantitative data, you will often need to use operational definitions that translate abstract concepts (e.g., mood) into observable and quantifiable measures (e.g., self-ratings of feelings and energy levels).

Prevent plagiarism, run a free check.

Once data is collected, you may need to process it before it can be analysed. For example, survey and test data may need to be transformed from words to numbers. Then, you can use statistical analysis to answer your research questions .

Descriptive statistics will give you a summary of your data and include measures of averages and variability. You can also use graphs, scatter plots and frequency tables to visualise your data and check for any trends or outliers.

Using inferential statistics , you can make predictions or generalisations based on your data. You can test your hypothesis or use your sample data to estimate the population parameter .

You can also assess the reliability and validity of your data collection methods to indicate how consistently and accurately your methods actually measured what you wanted them to.

Quantitative research is often used to standardise data collection and generalise findings . Strengths of this approach include:

• Replication

Repeating the study is possible because of standardised data collection protocols and tangible definitions of abstract concepts.

• Direct comparisons of results

The study can be reproduced in other cultural settings, times or with different groups of participants. Results can be compared statistically.

• Large samples

Data from large samples can be processed and analysed using reliable and consistent procedures through quantitative data analysis.

• Hypothesis testing

Using formalised and established hypothesis testing procedures means that you have to carefully consider and report your research variables, predictions, data collection and testing methods before coming to a conclusion.

Despite the benefits of quantitative research, it is sometimes inadequate in explaining complex research topics. Its limitations include:

• Superficiality

Using precise and restrictive operational definitions may inadequately represent complex concepts. For example, the concept of mood may be represented with just a number in quantitative research, but explained with elaboration in qualitative research.

• Narrow focus

Predetermined variables and measurement procedures can mean that you ignore other relevant observations.

• Structural bias

Despite standardised procedures, structural biases can still affect quantitative research. Missing data , imprecise measurements or inappropriate sampling methods are biases that can lead to the wrong conclusions.

• Lack of context

Quantitative research often uses unnatural settings like laboratories or fails to consider historical and cultural contexts that may affect data collection and results.

Quantitative research deals with numbers and statistics, while qualitative research deals with words and meanings.

Quantitative methods allow you to test a hypothesis by systematically collecting and analysing data, while qualitative methods allow you to explore ideas and experiences in depth.

In mixed methods research , you use both qualitative and quantitative data collection and analysis methods to answer your research question .

Data collection is the systematic process by which observations or measurements are gathered in research. It is used in many different contexts by academics, governments, businesses, and other organisations.

Operationalisation means turning abstract conceptual ideas into measurable observations.

For example, the concept of social anxiety isn’t directly observable, but it can be operationally defined in terms of self-rating scores, behavioural avoidance of crowded places, or physical anxiety symptoms in social situations.

Before collecting data , it’s important to consider how you will operationalise the variables that you want to measure.

Reliability and validity are both about how well a method measures something:

• Reliability refers to the  consistency of a measure (whether the results can be reproduced under the same conditions).
• Validity   refers to the  accuracy of a measure (whether the results really do represent what they are supposed to measure).

If you are doing experimental research , you also have to consider the internal and external validity of your experiment.

Hypothesis testing is a formal procedure for investigating our ideas about the world using statistics. It is used by scientists to test specific predictions, called hypotheses , by calculating how likely it is that a pattern or relationship between variables could have arisen by chance.

Cite this Scribbr article

If you want to cite this source, you can copy and paste the citation or click the ‘Cite this Scribbr article’ button to automatically add the citation to our free Reference Generator.

Bhandari, P. (2022, October 10). What Is Quantitative Research? | Definition & Methods. Scribbr. Retrieved 22 April 2024, from https://www.scribbr.co.uk/research-methods/introduction-to-quantitative-research/

Is this article helpful?

Pritha Bhandari

Quantitative and Qualitative Research

• I NEED TO . . .

What is Quantitative Research?

• What is Qualitative Research?
• Quantitative vs Qualitative
• Step 1: Accessing CINAHL
• Step 2: Create a Keyword Search
• Step 3: Create a Subject Heading Search
• Step 4: Repeat Steps 1-3 for Second Concept
• Step 5: Repeat Steps 1-3 for Quantitative Terms
• Step 6: Combining All Searches
• Step 7: Adding Limiters
• Step 8: Save Your Search!
• What Kind of Article is This?
• More Research Help This link opens in a new window

Quantitative methodology is the dominant research framework in the social sciences. It refers to a set of strategies, techniques and assumptions used to study psychological, social and economic processes through the exploration of numeric patterns . Quantitative research gathers a range of numeric data. Some of the numeric data is intrinsically quantitative (e.g. personal income), while in other cases the numeric structure is  imposed (e.g. ‘On a scale from 1 to 10, how depressed did you feel last week?’). The collection of quantitative information allows researchers to conduct simple to extremely sophisticated statistical analyses that aggregate the data (e.g. averages, percentages), show relationships among the data (e.g. ‘Students with lower grade point averages tend to score lower on a depression scale’) or compare across aggregated data (e.g. the USA has a higher gross domestic product than Spain). Quantitative research includes methodologies such as questionnaires, structured observations or experiments and stands in contrast to qualitative research. Qualitative research involves the collection and analysis of narratives and/or open-ended observations through methodologies such as interviews, focus groups or ethnographies.

Coghlan, D., Brydon-Miller, M. (2014).  The SAGE encyclopedia of action research  (Vols. 1-2). London, : SAGE Publications Ltd doi: 10.4135/9781446294406

What is the purpose of quantitative research?

The purpose of quantitative research is to generate knowledge and create understanding about the social world. Quantitative research is used by social scientists, including communication researchers, to observe phenomena or occurrences affecting individuals. Social scientists are concerned with the study of people. Quantitative research is a way to learn about a particular group of people, known as a sample population. Using scientific inquiry, quantitative research relies on data that are observed or measured to examine questions about the sample population.

Allen, M. (2017).  The SAGE encyclopedia of communication research methods  (Vols. 1-4). Thousand Oaks, CA: SAGE Publications, Inc doi: 10.4135/9781483381411

How do I know if the study is a quantitative design?  What type of quantitative study is it?

Quantitative Research Designs: Descriptive non-experimental, Quasi-experimental or Experimental?

Studies do not always explicitly state what kind of research design is being used.  You will need to know how to decipher which design type is used.  The following video will help you determine the quantitative design type.

• << Previous: I NEED TO . . .
• Next: What is Qualitative Research? >>
• Last Updated: Dec 8, 2023 10:05 PM
• URL: https://libguides.uta.edu/quantitative_and_qualitative_research

University of Texas Arlington Libraries 702 Planetarium Place · Arlington, TX 76019 · 817-272-3000

• Internet Privacy
• Accessibility
• Problems with a guide? Contact Us.

• USC Libraries
• Research Guides

Organizing Your Social Sciences Research Paper

• Quantitative Methods
• Purpose of Guide
• Design Flaws to Avoid
• Independent and Dependent Variables
• Glossary of Research Terms
• Reading Research Effectively
• Narrowing a Topic Idea
• Broadening a Topic Idea
• Extending the Timeliness of a Topic Idea
• Academic Writing Style
• Applying Critical Thinking
• Choosing a Title
• Making an Outline
• Paragraph Development
• Research Process Video Series
• Executive Summary
• The C.A.R.S. Model
• Background Information
• The Research Problem/Question
• Theoretical Framework
• Citation Tracking
• Content Alert Services
• Evaluating Sources
• Primary Sources
• Secondary Sources
• Tiertiary Sources
• Scholarly vs. Popular Publications
• Qualitative Methods
• Insiderness
• Using Non-Textual Elements
• Limitations of the Study
• Common Grammar Mistakes
• Writing Concisely
• Avoiding Plagiarism
• Footnotes or Endnotes?
• Further Readings
• Generative AI and Writing
• USC Libraries Tutorials and Other Guides
• Bibliography

Quantitative methods emphasize objective measurements and the statistical, mathematical, or numerical analysis of data collected through polls, questionnaires, and surveys, or by manipulating pre-existing statistical data using computational techniques . Quantitative research focuses on gathering numerical data and generalizing it across groups of people or to explain a particular phenomenon.

Babbie, Earl R. The Practice of Social Research . 12th ed. Belmont, CA: Wadsworth Cengage, 2010; Muijs, Daniel. Doing Quantitative Research in Education with SPSS . 2nd edition. London: SAGE Publications, 2010.

Need Help Locating Statistics?

Resources for locating data and statistics can be found here:

Statistics & Data Research Guide

Characteristics of Quantitative Research

Your goal in conducting quantitative research study is to determine the relationship between one thing [an independent variable] and another [a dependent or outcome variable] within a population. Quantitative research designs are either descriptive [subjects usually measured once] or experimental [subjects measured before and after a treatment]. A descriptive study establishes only associations between variables; an experimental study establishes causality.

Quantitative research deals in numbers, logic, and an objective stance. Quantitative research focuses on numeric and unchanging data and detailed, convergent reasoning rather than divergent reasoning [i.e., the generation of a variety of ideas about a research problem in a spontaneous, free-flowing manner].

Its main characteristics are :

• The data is usually gathered using structured research instruments.
• The results are based on larger sample sizes that are representative of the population.
• The research study can usually be replicated or repeated, given its high reliability.
• Researcher has a clearly defined research question to which objective answers are sought.
• All aspects of the study are carefully designed before data is collected.
• Data are in the form of numbers and statistics, often arranged in tables, charts, figures, or other non-textual forms.
• Project can be used to generalize concepts more widely, predict future results, or investigate causal relationships.
• Researcher uses tools, such as questionnaires or computer software, to collect numerical data.

The overarching aim of a quantitative research study is to classify features, count them, and construct statistical models in an attempt to explain what is observed.

  Things to keep in mind when reporting the results of a study using quantitative methods :

• Explain the data collected and their statistical treatment as well as all relevant results in relation to the research problem you are investigating. Interpretation of results is not appropriate in this section.
• Report unanticipated events that occurred during your data collection. Explain how the actual analysis differs from the planned analysis. Explain your handling of missing data and why any missing data does not undermine the validity of your analysis.
• Explain the techniques you used to "clean" your data set.
• Choose a minimally sufficient statistical procedure ; provide a rationale for its use and a reference for it. Specify any computer programs used.
• Describe the assumptions for each procedure and the steps you took to ensure that they were not violated.
• When using inferential statistics , provide the descriptive statistics, confidence intervals, and sample sizes for each variable as well as the value of the test statistic, its direction, the degrees of freedom, and the significance level [report the actual p value].
• Avoid inferring causality , particularly in nonrandomized designs or without further experimentation.
• Use tables to provide exact values ; use figures to convey global effects. Keep figures small in size; include graphic representations of confidence intervals whenever possible.
• Always tell the reader what to look for in tables and figures .

NOTE:   When using pre-existing statistical data gathered and made available by anyone other than yourself [e.g., government agency], you still must report on the methods that were used to gather the data and describe any missing data that exists and, if there is any, provide a clear explanation why the missing data does not undermine the validity of your final analysis.

Babbie, Earl R. The Practice of Social Research . 12th ed. Belmont, CA: Wadsworth Cengage, 2010; Brians, Craig Leonard et al. Empirical Political Analysis: Quantitative and Qualitative Research Methods . 8th ed. Boston, MA: Longman, 2011; McNabb, David E. Research Methods in Public Administration and Nonprofit Management: Quantitative and Qualitative Approaches . 2nd ed. Armonk, NY: M.E. Sharpe, 2008; Quantitative Research Methods. Writing@CSU. Colorado State University; Singh, Kultar. Quantitative Social Research Methods . Los Angeles, CA: Sage, 2007.

Basic Research Design for Quantitative Studies

Before designing a quantitative research study, you must decide whether it will be descriptive or experimental because this will dictate how you gather, analyze, and interpret the results. A descriptive study is governed by the following rules: subjects are generally measured once; the intention is to only establish associations between variables; and, the study may include a sample population of hundreds or thousands of subjects to ensure that a valid estimate of a generalized relationship between variables has been obtained. An experimental design includes subjects measured before and after a particular treatment, the sample population may be very small and purposefully chosen, and it is intended to establish causality between variables. Introduction The introduction to a quantitative study is usually written in the present tense and from the third person point of view. It covers the following information:

• Identifies the research problem -- as with any academic study, you must state clearly and concisely the research problem being investigated.
• Reviews the literature -- review scholarship on the topic, synthesizing key themes and, if necessary, noting studies that have used similar methods of inquiry and analysis. Note where key gaps exist and how your study helps to fill these gaps or clarifies existing knowledge.
• Describes the theoretical framework -- provide an outline of the theory or hypothesis underpinning your study. If necessary, define unfamiliar or complex terms, concepts, or ideas and provide the appropriate background information to place the research problem in proper context [e.g., historical, cultural, economic, etc.].

Methodology The methods section of a quantitative study should describe how each objective of your study will be achieved. Be sure to provide enough detail to enable the reader can make an informed assessment of the methods being used to obtain results associated with the research problem. The methods section should be presented in the past tense.

• Study population and sampling -- where did the data come from; how robust is it; note where gaps exist or what was excluded. Note the procedures used for their selection;
• Data collection – describe the tools and methods used to collect information and identify the variables being measured; describe the methods used to obtain the data; and, note if the data was pre-existing [i.e., government data] or you gathered it yourself. If you gathered it yourself, describe what type of instrument you used and why. Note that no data set is perfect--describe any limitations in methods of gathering data.
• Data analysis -- describe the procedures for processing and analyzing the data. If appropriate, describe the specific instruments of analysis used to study each research objective, including mathematical techniques and the type of computer software used to manipulate the data.

Results The finding of your study should be written objectively and in a succinct and precise format. In quantitative studies, it is common to use graphs, tables, charts, and other non-textual elements to help the reader understand the data. Make sure that non-textual elements do not stand in isolation from the text but are being used to supplement the overall description of the results and to help clarify key points being made. Further information about how to effectively present data using charts and graphs can be found here .

• Statistical analysis -- how did you analyze the data? What were the key findings from the data? The findings should be present in a logical, sequential order. Describe but do not interpret these trends or negative results; save that for the discussion section. The results should be presented in the past tense.

Discussion Discussions should be analytic, logical, and comprehensive. The discussion should meld together your findings in relation to those identified in the literature review, and placed within the context of the theoretical framework underpinning the study. The discussion should be presented in the present tense.

• Interpretation of results -- reiterate the research problem being investigated and compare and contrast the findings with the research questions underlying the study. Did they affirm predicted outcomes or did the data refute it?
• Description of trends, comparison of groups, or relationships among variables -- describe any trends that emerged from your analysis and explain all unanticipated and statistical insignificant findings.
• Discussion of implications – what is the meaning of your results? Highlight key findings based on the overall results and note findings that you believe are important. How have the results helped fill gaps in understanding the research problem?
• Limitations -- describe any limitations or unavoidable bias in your study and, if necessary, note why these limitations did not inhibit effective interpretation of the results.

Conclusion End your study by to summarizing the topic and provide a final comment and assessment of the study.

• Summary of findings – synthesize the answers to your research questions. Do not report any statistical data here; just provide a narrative summary of the key findings and describe what was learned that you did not know before conducting the study.
• Recommendations – if appropriate to the aim of the assignment, tie key findings with policy recommendations or actions to be taken in practice.
• Future research – note the need for future research linked to your study’s limitations or to any remaining gaps in the literature that were not addressed in your study.

Black, Thomas R. Doing Quantitative Research in the Social Sciences: An Integrated Approach to Research Design, Measurement and Statistics . London: Sage, 1999; Gay,L. R. and Peter Airasain. Educational Research: Competencies for Analysis and Applications . 7th edition. Upper Saddle River, NJ: Merril Prentice Hall, 2003; Hector, Anestine. An Overview of Quantitative Research in Composition and TESOL . Department of English, Indiana University of Pennsylvania; Hopkins, Will G. “Quantitative Research Design.” Sportscience 4, 1 (2000); "A Strategy for Writing Up Research Results. The Structure, Format, Content, and Style of a Journal-Style Scientific Paper." Department of Biology. Bates College; Nenty, H. Johnson. "Writing a Quantitative Research Thesis." International Journal of Educational Science 1 (2009): 19-32; Ouyang, Ronghua (John). Basic Inquiry of Quantitative Research . Kennesaw State University.

Strengths of Using Quantitative Methods

Quantitative researchers try to recognize and isolate specific variables contained within the study framework, seek correlation, relationships and causality, and attempt to control the environment in which the data is collected to avoid the risk of variables, other than the one being studied, accounting for the relationships identified.

Among the specific strengths of using quantitative methods to study social science research problems:

• Allows for a broader study, involving a greater number of subjects, and enhancing the generalization of the results;
• Allows for greater objectivity and accuracy of results. Generally, quantitative methods are designed to provide summaries of data that support generalizations about the phenomenon under study. In order to accomplish this, quantitative research usually involves few variables and many cases, and employs prescribed procedures to ensure validity and reliability;
• Applying well established standards means that the research can be replicated, and then analyzed and compared with similar studies;
• You can summarize vast sources of information and make comparisons across categories and over time; and,
• Personal bias can be avoided by keeping a 'distance' from participating subjects and using accepted computational techniques .

Babbie, Earl R. The Practice of Social Research . 12th ed. Belmont, CA: Wadsworth Cengage, 2010; Brians, Craig Leonard et al. Empirical Political Analysis: Quantitative and Qualitative Research Methods . 8th ed. Boston, MA: Longman, 2011; McNabb, David E. Research Methods in Public Administration and Nonprofit Management: Quantitative and Qualitative Approaches . 2nd ed. Armonk, NY: M.E. Sharpe, 2008; Singh, Kultar. Quantitative Social Research Methods . Los Angeles, CA: Sage, 2007.

Limitations of Using Quantitative Methods

Quantitative methods presume to have an objective approach to studying research problems, where data is controlled and measured, to address the accumulation of facts, and to determine the causes of behavior. As a consequence, the results of quantitative research may be statistically significant but are often humanly insignificant.

Some specific limitations associated with using quantitative methods to study research problems in the social sciences include:

• Quantitative data is more efficient and able to test hypotheses, but may miss contextual detail;
• Uses a static and rigid approach and so employs an inflexible process of discovery;
• The development of standard questions by researchers can lead to "structural bias" and false representation, where the data actually reflects the view of the researcher instead of the participating subject;
• Results provide less detail on behavior, attitudes, and motivation;
• Researcher may collect a much narrower and sometimes superficial dataset;
• Results are limited as they provide numerical descriptions rather than detailed narrative and generally provide less elaborate accounts of human perception;
• The research is often carried out in an unnatural, artificial environment so that a level of control can be applied to the exercise. This level of control might not normally be in place in the real world thus yielding "laboratory results" as opposed to "real world results"; and,
• Preset answers will not necessarily reflect how people really feel about a subject and, in some cases, might just be the closest match to the preconceived hypothesis.

Research Tip

Finding Examples of How to Apply Different Types of Research Methods

SAGE publications is a major publisher of studies about how to design and conduct research in the social and behavioral sciences. Their SAGE Research Methods Online and Cases database includes contents from books, articles, encyclopedias, handbooks, and videos covering social science research design and methods including the complete Little Green Book Series of Quantitative Applications in the Social Sciences and the Little Blue Book Series of Qualitative Research techniques. The database also includes case studies outlining the research methods used in real research projects. This is an excellent source for finding definitions of key terms and descriptions of research design and practice, techniques of data gathering, analysis, and reporting, and information about theories of research [e.g., grounded theory]. The database covers both qualitative and quantitative research methods as well as mixed methods approaches to conducting research.

SAGE Research Methods Online and Cases

• << Previous: Qualitative Methods
• Next: Insiderness >>
• Last Updated: Apr 24, 2024 10:51 AM
• URL: https://libguides.usc.edu/writingguide

• (855) 776-7763

Training Maker

All Products

Qualaroo Insights

ProProfs.com

• Sign Up Free

Do you want a free Survey Software?

We have the #1 Online Survey Maker Software to get actionable user insights.

A Comprehensive Guide to Quantitative Research: Types, Characteristics, Methods & Examples

Step into the fascinating world of quantitative research, where numbers reveal extraordinary insights!

By gathering and studying data in a systematic way, quantitative research empowers us to understand our ever-changing world better. It helps understand a problem or an already-formed hypothesis by generating numerical data. The results don’t end here, as you can process these numbers to get actionable insights that aid decision-making.

You can use quantitative research to quantify opinions, behaviors, attitudes, and other definitive variables related to the market, customers, competitors, etc. The research is conducted on a larger sample population to draw predictive, average, and pattern-based insights.

Here, we delve into the intricacies of this research methodology, exploring various quantitative methods, their advantages, and real-life examples that showcase their impact and relevance.

Ready to embark on a journey of discovery and knowledge? Let’s go!

What Is Quantitative Research?

Quantitative research is a method that uses numbers and statistics to test theories about customer attitudes and behaviors. It helps researchers gather and analyze data systematically to gain valuable insights and draw evidence-based conclusions about customer preferences and trends.

Researchers use online surveys , questionnaires , polls , and quizzes to question a large number of people to obtain measurable and bias-free data.

In technical terms, quantitative research is mainly concerned with discovering facts about social phenomena while assuming a fixed and measurable reality.

Offering numbers and stats-based insights, this research methodology is a crucial part of primary research and helps understand how well an organizational decision is going to work out.

Let’s consider an example.

Suppose your qualitative analysis shows that your customers are looking for social media-based customer support . In that case, quantitative analysis will help you see how many of your customers are looking for this support.

If 10% of your customers are looking for such a service, you might or might not consider offering this feature. But, if 40% of your regular customers are seeking support via social media, then it is something you just cannot overlook.

Characteristics of Quantitative Research

Quantitative research clarifies the fuzziness of research data from qualitative research analysis. With numerical insights, you can formulate a better and more profitable business decision.

Hence, quantitative research is more readily contestable, sharpens intelligent discussion, helps you see the rival hypotheses, and dynamically contributes to the research process.

Let us have a quick look at some of its characteristics.

• Measurable Variables

The data collection methods in quantitative research are structured and contain items requiring measurable variables, such as age, number of family members, salary range, highest education, etc.

These structured data collection methods comprise polls, surveys, questionnaires, etc., and may have questions like the ones shown in the following image:

As you can see, all the variables are measurable. This ensures that the research is in-depth and provides less erroneous data for reliable, actionable insights.

• Sample Size

No matter what data analysis methods for quantitative research are being used, the sample size is kept such that it represents the target market.

As the main aim of the research methodology is to get numerical insights, the sample size should be fairly large. Depending on the survey objective and scope, it might span hundreds of thousands of people.

• Normal Population Distribution

To maintain the reliability of a quantitative research methodology, we assume that the population distribution curve is normal.

This type of population distribution curve is preferred over a non-normal distribution as the sample size is large, and the characteristics of the sample vary with its size.

This requires adhering to the random sampling principle to avoid the researcher’s bias in result interpretation. Any bias can ruin the fairness of the entire process and defeats the purpose of research.

• Well-Structured Data Representation

Data analysis in quantitative research produces highly structured results and can form well-defined graphical representations. Some common examples include tables, figures, graphs, etc., that combine large blocks of data.

This way, you can discover hidden data trends, relationships, and differences among various measurable variables. This can help researchers understand the survey data and formulate actionable insights for decision-making.

• Predictive Outcomes

Quantitative analysis of data can also be used for estimations and prediction outcomes. You can construct if-then scenarios and analyze the data for the identification of any upcoming trends or events.

However, this requires advanced analytics and involves complex mathematical computations. So, it is mostly done via quantitative research tools that come with advanced analytics capabilities.

8 Best Practices to Conduct Quantitative Research

Here are some best practices to keep in mind while conducting quantitative research:

1. Define Research Objectives

There can be many ways to collect data via quantitative research methods that are chosen as per the research objective and scope. These methods allow you to build your own observations regarding any hypotheses – unknown, entirely new, or unexplained. 

You can hypothesize a proof and build a prediction of outcomes supporting the same. You can also create a detailed stepwise plan for data collection, analysis, and testing. 

Below, we explore quantitative research methods and discuss some examples to enhance your understanding of them.

2. Keep Your Questions Simple

The surveys are meant to reach people en-masse, and that includes a wide demographic range with recipients from all walks of life. Asking simple questions will ensure that they grasp what’s being asked easily.

Read More: Proven Tips to Avoid Leading and Loaded Questions in Your Survey

3. Develop a Solid Research Design

Choose an appropriate research design that aligns with your objectives, whether it’s experimental, quasi-experimental, or correlational. You also need to pay attention to the sample size and sampling technique such that it represents the target population accurately.

4. Use Reliable & Valid Instruments

It’s crucial to select or develop measurement instruments such as questionnaires, scales, or tests that have been validated and are reliable. Before proceeding with the main study, pilot-test these instruments on a small sample to assess their effectiveness and make any necessary improvements.

5. Ensure Data Quality

Implement data collection protocols to minimize errors and bias during data gathering. Double-check data entries and cleaning procedures to eliminate any inconsistencies or missing values that may affect the accuracy of your results. For instance, you might regularly cross-verify data entries to identify and correct any discrepancies.

6. Employ Appropriate Data Analysis Techniques

Select statistical methods that match the nature of your data and research questions. Whether it’s regression analysis, t-tests, ANOVA, or other techniques, using the right approach is important for drawing meaningful conclusions. Utilize software tools like SPSS or R for data analysis to ensure the accuracy and reproducibility of your findings.

7. Interpret Results Objectively

Present your findings in a clear and unbiased manner. Avoid making unwarranted causal claims, especially in correlational studies. Instead, focus on describing the relationships and patterns observed in your data.

8. Address Ethical Considerations

Prioritize ethical considerations throughout your research process. Obtain informed consent from participants, ensuring their voluntary participation and confidentiality of data. Comply with ethical guidelines and gain approval from a governing body if necessary.

Read More: How to Find Survey Participants & Respondents

Types of Quantitative Research Methods

Quantitative research is usually conducted using two methods. They are-

• Primary quantitative research methods
• Secondary quantitative research methods

1. Primary Methods

Primary quantitative research is the most popular way of conducting market research. The differentiating factor of this method is that the researcher relies on collecting data firsthand instead of relying on data collected from previous research.

There are multiple types of primary quantitative research. They can be distinguished based on three distinctive aspects, which are:

A. Techniques & Types of Studies:

• Survey Research

Surveys are the easiest, most common, and one of the most sought-after quantitative research techniques. The main aim of a survey is to widely gather and describe the characteristics of a target population or customers. Surveys are the foremost quantitative method preferred by both small and large organizations.

They help them understand their customers, products, and other brand offerings in a proper manner.

Surveys can be conducted using various methods, such as online polls, web-based surveys, paper questionnaires, phone calls, or face-to-face interviews. Survey research allows organizations to understand customer opinions, preferences, and behavior, making it crucial for market research and decision-making.

You can watch this quick video to learn more about creating surveys.

Surveys are of two types:

• Cross-Sectional Surveys Cross-sectional surveys are used to collect data from a sample of the target population at a specific point in time. Researchers evaluate various variables simultaneously to understand the relationships and patterns within the data.
• Cross-sectional surveys are popular in retail, small and medium-sized enterprises (SMEs), and healthcare industries, where they assess customer satisfaction, market trends, and product feedback.
• Longitudinal Surveys Longitudinal surveys are conducted over an extended period, observing changes in respondent behavior and thought processes.
• Researchers gather data from the same sample multiple times, enabling them to study trends and developments over time. These surveys are valuable in fields such as medicine, applied sciences, and market trend analysis.

Surveys can be distributed via various channels. Some of the most popular ones are listed below:

• Email: Sending surveys via email is a popular and effective method. People recognize your brand, leading to a higher response rate. With ProProfs Survey Maker’s in-mail survey-filling feature, you can easily send out and collect survey responses.
• Embed on a website: Boost your response rate by embedding the survey on your website. When visitors are already engaged with your brand, they are more likely to take the survey.
• Social media: Take advantage of social media platforms to distribute your survey. People familiar with your brand are likely to respond, increasing your response numbers.
• QR codes: QR codes store your survey’s URL, and you can print or publish these codes in magazines, signs, business cards, or any object to make it easy for people to access your survey.
• SMS survey: Collect a high number of responses quickly with SMS surveys. It’s a time-effective way to reach your target audience.

Read More: 24 Different Types of Survey Methods With Examples

2. Correlational Research:

Correlational research aims to establish relationships between two or more variables.

Researchers use statistical analysis to identify patterns and trends in the data, but it does not determine causality between the variables. This method helps understand how changes in one variable may impact another.

Examples of correlational research questions include studying the relationship between stress and depression, fame and money, or classroom activities and student performance.

3. Causal-Comparative Research:

Causal-comparative research, also known as quasi-experimental research, seeks to determine cause-and-effect relationships between variables.

Researchers analyze how an independent variable influences a dependent variable, but they do not manipulate the independent variable. Instead, they observe and compare different groups to draw conclusions.

Causal-comparative research is useful in situations where it’s not ethical or feasible to conduct true experiments.

Examples of questions for this type of research include analyzing the effect of training programs on employee performance, studying the influence of customer support on client retention, investigating the impact of supply chain efficiency on cost reduction, etc.

4. Experimental Research:

Experimental research is based on testing theories to validate or disprove them. Researchers conduct experiments and manipulate variables to observe their impact on the outcomes.

This type of research is prevalent in natural and social sciences, and it is a powerful method to establish cause-and-effect relationships. By randomly assigning participants to experimental and control groups, researchers can draw more confident conclusions.

Examples of experimental research include studying the effectiveness of a new drug, the impact of teaching methods on student performance, or the outcomes of a marketing campaign.

B. Data collection methodologies

After defining research objectives, the next significant step in primary quantitative research is data collection. This involves using two main methods: sampling and conducting surveys or polls.

Sampling methods:

In quantitative research, there are two primary sampling methods: Probability and Non-probability sampling.

Probability Sampling

In probability sampling, researchers use the concept of probability to create samples from a population. This method ensures that every individual in the target audience has an equal chance of being selected for the sample.

There are four main types of probability sampling:

• Simple random sampling: Here, the elements or participants of a sample are selected randomly, and this technique is used in studies that are conducted over considerably large audiences. It works well for large target populations.
• Stratified random sampling: In this method, the entire population is divided into strata or groups, and the sample members get chosen randomly from these strata only. It is always ensured that different segregated strata do not overlap with each other.
• Cluster sampling: Here, researchers divide the population into clusters, often based on geography or demographics. Then, random clusters are selected for the sample.
• Systematic sampling: In this method, only the starting point of the sample is randomly chosen. All the other participants are chosen using a fixed interval. Researchers calculate this interval by dividing the size of the study population by the target sample size.

Non-probability Sampling

Non-probability sampling is a method where the researcher’s knowledge and experience guide the selection of samples. This approach doesn’t give all members of the target population an equal chance of being included in the sample.

There are five non-probability sampling models:

• Convenience sampling: The elements or participants are chosen on the basis of their nearness to the researcher. The people in close proximity can be studied and analyzed easily and quickly, as there is no other selection criterion involved. Researchers simply choose samples based on what is most convenient for them.
• Consecutive sampling: Similar to convenience sampling, researchers select samples one after another over a significant period. They can opt for a single participant or a group of samples to conduct quantitative research in a consecutive manner for a significant period of time. Once this is over, they can conduct the research from the start.
• Quota sampling: With quota sampling, researchers use their understanding of target traits and personalities to form groups (strata). They then choose samples from each stratum based on their own judgment.
• Snowball sampling: This method is used where the target audiences are difficult to contact and interviewed for data collection. Researchers start with a few participants and then ask them to refer others, creating a snowball effect.
• Judgmental sampling: In judgmental sampling, researchers rely solely on their experience and research skills to handpick samples that they believe will be most relevant to the study.

Read More: Data Collection Methods: Definition, Types & Examples

C. Data analysis techniques

To analyze the quantitative data accurately, you’ll need to use specific statistical methods such as:

• SWOT Analysis: This stands for Strengths, Weaknesses, Opportunities, and Threats analysis. Organizations use SWOT analysis to evaluate their performance internally and externally. It helps develop effective improvement strategies.
• Conjoint Analysis: This market research method uncovers how individuals make complex purchasing decisions. It involves considering trade-offs in their daily activities when choosing from a list of product/service options.
• Cross-tabulation: A preliminary statistical market analysis method that reveals relationships, patterns, and trends within various research study parameters.
• TURF Analysis: Short for Totally Unduplicated Reach and Frequency Analysis, this method helps analyze the reach and frequency of favorable communication sources. It provides insights into the potential of a target market.
• By using these statistical techniques and inferential statistics methods like confidence intervals and margin of error, you can draw meaningful insights from your primary quantitative research that you can use in making informed decisions.

II. Secondary Quantitative Research Methods

• Secondary quantitative research, also known as desk research, is a valuable method that uses existing data, called secondary data.
• Instead of collecting new data, researchers analyze and combine already available information to enhance their research. This approach involves gathering quantitative data from various sources such as the internet, government databases, libraries, and research reports.
• Secondary quantitative research plays a crucial role in validating data collected through primary quantitative research. It helps reinforce or challenge existing findings.

Here are five commonly used secondary quantitative research methods:

A. Data Available on the Internet:

The Internet has become a vast repository of data, making it easier for researchers to access a wealth of information. Online databases, websites, and research repositories provide valuable quantitative data for researchers to analyze and validate their primary research findings.

B. Government and Non-Government Sources:

Government agencies and non-government organizations often conduct extensive research and publish reports. These reports cover a wide range of topics, providing researchers with reliable and comprehensive data for quantitative analysis.

C. Public Libraries:

While less commonly used in the digital age, public libraries still hold valuable research reports, historical data, and publications that can contribute to quantitative research.

D. Educational Institutions:

Educational institutions frequently conduct research on various subjects. Their research reports and publications can serve as valuable sources of information for researchers, validating and supporting primary quantitative research outcomes.

E. Commercial Information Sources:

Commercial sources such as local newspapers, journals, magazines, and media outlets often publish relevant data on economic trends, market research, and demographic analyses. Researchers can access this data to supplement their own findings and draw better conclusions.

Advantages of Quantitative Research Methods

Quantitative research data is often standardized and can be easily used to generalize findings for making crucial business decisions and uncover insights to supplement the qualitative research findings.

Here are some core benefits this research methodology offers.

Direct Result Comparison

As the studies can be replicated for different cultural settings and different times, even with different groups of participants, they tend to be extremely useful. Researchers can compare the results of different studies in a statistical manner and arrive at comprehensive conclusions for a broader understanding.

Replication

Researchers can repeat the study by using standardized data collection protocols over well-structured data sets. They can also apply tangible definitions of abstract concepts to arrive at different conclusions for similar research objectives with minor variations.

Large Samples

As the research data comes from large samples, the researchers can process and analyze the data via highly reliable and consistent analysis procedures. They can arrive at well-defined conclusions that can be used to make the primary research more thorough and reliable.

Hypothesis Testing

This research methodology follows standardized and established hypothesis testing procedures. So, you have to be careful while reporting and analyzing your research data , and the overall quality of results gets improved.

Proven Examples of Quantitative Research Methods

Below, we discuss two excellent examples of quantitative research methods that were used by highly distinguished business and consulting organizations. Both examples show how different types of analysis can be performed with qualitative approaches and how the analysis is done once the data is collected.

1. STEP Project Global Consortium / KPMG 2019 Global Family Business survey

This research utilized quantitative methods to identify ways that kept the family businesses sustainably profitable with time.

The study also identified the ways in which the family business behavior changed with demographic changes and had “why” and “how” questions. Their qualitative research methods allowed the KPMG team to dig deeper into the mindsets and perspectives of the business owners and uncover unexpected research avenues as well.

It was a joint effort in which STEP Project Global Consortium collected 26 cases, and KPMG collected 11 cases.

The research reached the stage of data analysis in 2020, and the analysis process spanned over 4 stages.

The results, which were also the reasons why family businesses tend to lose their strength with time, were found to be:

• Family governance
• Family business legacy

2. EY Seren Teams Research 2020

This is yet another commendable example of qualitative research where the EY Seren Team digs into the unexplored depths of human behavior and how it affected their brand or service expectations.

The research was done across 200+ sources and involved in-depth virtual interviews with people in their homes, exploring their current needs and wishes. It also involved diary studies across the entire UK customer base to analyze human behavior changes and patterns.

The study also included interviews with professionals and design leaders from a wide range of industries to explore how COVID-19 transformed their industries. Finally, quantitative surveys were conducted to gain insights into the EY community after every 15 days.

The insights and results were:

• A culture of fear, daily resilience, and hopes for a better world and a better life – these were the macro trends.
• People felt massive digitization to be a resourceful yet demanding aspect as they have to adapt every day.
• Some people wished to have a new world with lots of possibilities, and some were looking for a new purpose.

Enhance Your Quantitative Research With Cutting-Edge Software

While no single research methodology can produce 100% reliable results, you can always opt for a hybrid research method by opting for the methods that are most relevant to your objective.

This understanding comes gradually as you learn how to implement the correct combination of qualitative and quantitative research methods for your research projects. For the best results, we recommend investing in smart, efficient, and scalable research tools that come with delightful reporting and advanced analytics to make every research initiative a success.

These software tools, such as ProProfs Survey Maker, come with pre-built survey templates and question libraries and allow you to create a high-converting survey in just a few minutes.

So, choose the best research partner, create the right research plan, and gather insights that drive sustainable growth for your business.

About the author

Emma David is a seasoned market research professional with 8+ years of experience. Having kick-started her journey in research, she has developed rich expertise in employee engagement, survey creation and administration, and data management. Emma believes in the power of data to shape business performance positively. She continues to help brands and businesses make strategic decisions and improve their market standing through her understanding of research methodologies.

Popular Posts in This Category

Voice of Customer Survey: Questions, Examples ,Types & Strategies

How to Analyze Survey Data Like a Pro

Email Surveys: 30+ Questions, Types And Examples

18 Ways to Create Survey Email Subject Lines With Examples

Client Onboarding Questionnaire: Best Practices & 20+ Questions

Create the Perfect Employee Evaluation Form: Templates and Detailed Guide

9 Quantitative Research Methods With Real Client Examples

• June 21, 2021
• Tallwave Team

Share Article

Quantitative research is essential to developing a clear understanding of consumer engagement and how to increase satisfaction.

Primary Quantitative Research Methods

When it comes to quantitative research, many people often confuse this type of research with the methodology. The research type refers to style of research while the data collection method can be different.

Research types

These are the primary types of quantitative research used by businesses today.

• Survey research: Ideally when conducting survey research businesses will use a statistically relevant sample to understand the sentiments and actions of a large group of people. This could be their current customers or consumers who fit into their ideal demographic.
• Correlational research: Correlational research compares two variables to come to a conclusion about whether there is a relationship between the two. Keep in mind that correlation does not always imply causation, which is to say you need to account for external variables that could cause an apparent relationship.
• Experimental research: This form of research takes a scientific approach, testing a hypothesis by manipulating certain variables to understand what changes this could cause. In these experiments, there is a control group and a manipulated group.

Also read:  6 Factors Influencing Customer Behaviors in 2021

Data collection methods

Launching the above research requires creating a plan to collect data. After all, quantitative research relies on data. Here are the common primary data collection methods for quantitative research.

• Surveys: A common approach to collecting data is using a survey. This is ideal especially if the business can obtain a statistically relevant sample from their responses. Surveys are often conducted through web or email questionnaires.
• Interviews: Yes, interviews can be used to obtain quantitative data. While this form of data collection is typically associated with qualitative research, interviewers can ask a standard set of questions to collate formal, quantitative data.
• Documentation review: With an increasing amount of business occurring digitally, there is more documentation now than ever before to help inform quantitative conclusions. Businesses can assess website metrics such as return visits, time on page or even use a pixel to track customer movement across websites. They can also view how many times their app has been opened and actions users have taken on their platform to determine customer engagement.

Secondary research can be helpful when formulating a plan for obtaining primary quantitative data. It can help narrow areas of focus or illuminate key challenges.

Secondary Quantitative Research Methods

Secondary data is information that is already collected and not necessarily exclusive to the company but still relevant when understanding overall industry and marketplace trends. Here are a few examples of secondary data:

• Government reports: Government research can indicate potential regulatory roadblocks, customer pain points and future opportunities. For example, a fitness company might use government data that shows an increase in use of outdoor running trials to develop a new product used to meet that specific use case.
• Survey-based secondary data: Polls or surveys that have been conducted for a primary use could be reused for secondary purposes. This could include survey data obtained by other companies or governments.
• Academic research: Research that has been previously conducted and published in peer-reviewed journals can help inform trends and consumer behavior, even if it doesn’t apply to a company’s specific customers.

Secondary research can be helpful when formulating a plan for obtaining primary quantitative data. It can help narrow areas of focus or illuminate key challenges. It can also help when it comes to interpreting primary data, especially when trying to understand the relationship between two variables of correlated data.

Also read:  The What, Why, & How of Customer Behavior Analysis

Real Examples of Quantitative Research

We regularly use quantitative research to help our clients understand where they can best add value to increase customer engagement. Here are three examples of quantitative research in motion.

Example 1: Leading food distribution company

We helped a leading food distribution company identify changes in the needs and values of their restaurant clients as a result of COVID-19. This helped inform opportunities to become more valuable partners.

The research plan involved creating a survey that was emailed to clients. The questions were specific and numeric. For example, respondents were asked what percentage of their weekly spend was used with the food distribution company. They were also asked to assign a percentage to the way their food ordering had changed during COVID-19 and to rate their satisfaction with the food distribution company.

The results showed changes that had occurred for clients of the food distribution company as a result of the unique stressors of the pandemic. We were able to determine changes in weekly food supply and customer count as well as menu adaptations and purchase behavior.

Example 2: Leading credit card company

Our work with a leading credit card company required us to understand what current travel card members valued about the rewards program and their preferred communication method for booking travel in order to create an omnichannel servicing strategy and ideal customer journey.

Through an online survey of younger cardholders, the target demographic for this project, we asked questions such as length of card membership, total spend and the number of annual leisure trips in addition to more specific questions that showed how members get inspiration for trip planning and where they research.

The results highlighted ways to overcome resistance to pricing by proving more value. It also illuminated ways to make the benefits of membership more tangible to card holders and how to influence travelers in the early stages of planning their journey.

Example 3: Internal research report

We’re in the business of drinking our own champagne, so to speak, which is why we conducted our own quantitative research aimed at understanding the consumer trends that were spurred by the pandemic and how these will transform behaviors in the future.

There’s no question that new customer experiences emerged from the pandemic. Think of offerings such as “buy online, pickup in store (BOPIS),” or blended restaurant meals that are cooked at home. We wanted to understand how consumers truly felt about these new experiences and which they were likely to continue using even after restrictions were lifted. We also wanted to know more about the changing expectations for branded communication and how all of these pieces of the puzzle fit together to create consumer engagement. Our method of data collection was a survey.

Our research led us to develop insights we could use to inform our customers in their decision making. For example, we found convenience is paramount for consumers who are seeking out hybrid experiences such as BOPIS to take the best of both worlds. We also found many of these changes are permanent as consumers embraced new experiences that made their lives easier.

We regularly use quantitative research to help our clients understand where they can best add value to increase customer engagement.

The Bottom Line

Quantitative research is essential to developing a clear understanding of consumer engagement and how to increase satisfaction. Though online surveys are one of the most common methods for obtaining data, research isn’t limited to this strategy. It’s important to use whatever strategies are within your scope to constantly evaluate new trends and consumer behaviors that could significantly impact your offerings. The results can show you how to re-engage customers and drive loyalty.

Interested in partnering with us to learn more about your customers needs, wants, and behaviors to inform future experience design? Contact us today !

Tallwave Headquarters

6720 N. Scottsdale Road, Suite 140 Scottsdale, Arizona 85253 (602) 840-0400

For business inquiries, contact Ed Borromeo, Tallwave Partner at [email protected]

©2024 Tallwave LLC. All rights reserved.

Terms of Use

Bunger Steel

Doing some things and making some impacts

Quantitative Research: Methods And Examples

Santosh took over as manager of a breakfast cereal brand at a large corporation. He soon found that sales were…

Santosh took over as manager of a breakfast cereal brand at a large corporation. He soon found that sales were weak compared to their competitors despite their large market penetration. He commissioned detailed research into why the product wasn’t doing well, including a survey of customer preferences. Soon, he discovered consumers weren’t enjoying the flavor, finding it too sweet.

  A survey is a kind of quantitative research frequently used to collect data.

What is quantitative research ? It involves gathering information through interviews, observation and experiments. The results are often available as charts, tables or numerical values. Collecting large amounts of information allows for the statistical analysis of data.  

Quantitative research is used to discover patterns in or differences between populations or objects of interest. It can be collected in many ways. Let’s dive in to understand the meaning of quantitative research and its place in the world of research.

What Is Quantitative Research?

Quantitative research vs. qualitative research, quantitative methods in business, quantitative analysis for strategic planning.

Quantitative research is one of two primary methods of understanding the world through research, the other being qualitative research. As the names suggest, quantitative methods look at matters through a numerical lens, while qualitative research is more subjective in scope.

  When trying to define quantitative research , there are four types we discuss most frequently:

Observation

Secondary research.

The term quantitative research covers a lot of ground. Which data collection methods researchers finally choose will depend on the subject and scope. For instance, if an organization wants to study the use of various detergents in a city, they could opt for a survey. On the other hand, if a start-up is developing a new kind of bio-fuel, they would have to conduct detailed experiments to gather data.

  Now that we’ve been able to define quantitative research , we can dig a little deeper into its characteristics.

  When presented with a question, researchers must first decide whether a qualitative approach is needed or a quantitative one. Sometimes the answer is one or the other, or it could even be a combination of both. Research design is a subject that requires thought. Here are some features of both:

• Quantitative research uses numbers and statistical analysis
• Quantitative methods collect data based on variables such as age, gender, occupation, marital status, ethnicity and religious affiliation
• Quantitative methods are not appropriate for subjects that can’t be assigned a numerical value. They can be used for more subjective matters, but it takes careful research design
• Qualitative research involves interviews, observations, or experiments to provide a detailed picture of a topic

There are some advantages and disadvantages of both methods that apply to most research situations. Some strengths of each method include:

• Qualitative research may not produce statistics. Quantitative research can generate numbers from the data being gathered
• Quantitative research methods can be used comparatively quickly, and the results generated can be interpreted with certainty. This is compared to qualitative research, which can take much longer and requires more resources to complete
• A quantitative study can be extremely accurate because the numbers tell researchers when certain conditions are met. In qualitative research, there are no numbers associated with it and it uses qualities such as observation, interviews and participant feedback in determining what is happening
• Quantitative research can be used in a variety of applications and forms. We can use it for marketing, policy making, sociology and psychology
• Quantitative studies can involve many variables and experiments at one time compared to qualitative researchers who must limit their focus to get usable data

Choosing the right approach could mean the difference between failure and success in learning about the subject. With a clear understanding of quantitative research meaning, these decisions become easier.

  Studying some examples of quantitative research can help businesses achieve goals and objectives. Quantitative methods allow us a better understanding of customers and markets, improving sales and profitability.

  There are several types of quantitative analyses in marketing. Let’s take a closer look.

Market Segmentation

Market analysis, market forecasting, market research, operational analysis,  data analysis.

Quantitative analysis has far-ranging applications for business and management.

Quantitative research in business can be used in decision-making. It helps analyze large amounts of data, such as:

• Changes in income, sales, inventory and capital spending
• Profitability through cost of goods, labor costs or operating expenses
• Competitive advantages through pricing or production costs
• Limits of market access due to cost constraints
• Trends in market share by analyzing sales over time
• Product acceptance by analysis of satisfaction scores achieved by customers

Managers might commission a quantitative study to gather data on the current situation and then use this information to plan measures to course-correct where needed.

  Before embarking on a quantitative study, first identify your desired goals. There are many statistical measures to determine the success or failure of any study. The data can also be used to formulate a hypothesis that best explains the results.

For managers to achieve mastery over analytical tools, it can take significant amounts of hard work and experience. Harappa’s Thinking Critically course provides professionals with transformative information and insight into how to make the best decisions under pressure. It helps them on the way to the mature thinking needed to process information, arrive at proper conclusions and structure persuasive arguments. These traits are an asset in every workplace and as professionals grow through the stages of their careers. Strengthen your teams today with Harappa.

Explore Harappa Diaries to learn more about topics such as Main Objectives of Research , Methods Of Qualitative Research , Examples of Experimental Research and Understand Classical Conditioning Theory of Learning to upgrade your knowledge and skills.

How To Write Methodology For A Quantitative Study?

Methodology Chapter Provides Information On All The Steps Taken For The Study Of A Problem And The Justifications Given For Specific Steps Taken To Gather, Process, And Analyze Data Related To Understanding The Problem. The Chapter Allows The Reader To Understand And Evaluate The Research Design And Thus Validate It.

Quantitative Study: Quantitative Research Is The Quantification Of A Problem Via Generating Numerical Data That Are Most Often Converted Into Statistics. The Statistical Analysis In Research Methodology Helps In Proving Or Disproving A Thesis. The Research Is Usually Conducted Among A Broad Populace In The Form Of Questionnaire, Polls And Other Surveys Which Involves The Participants To Reply In Numbers. This Means Quantitative Research Falls Under The Headings Of Empirical Or Statistical Studies. Its Main Characteristics Are :

• Use Of Standard Instruments To Gather Data.
• Sizes Of The Samples Are Proportional To That Of The Population In Question.
• Research Is Conducted On A Well-Defined Question.
• Studies Are Well Designed Before The Process.
• Numerical Data That Quantify A Problem Or An Area Of Research Using Various Means Like Charts, Tables, Graphs, Etc. Data Collection Carried Out Through Surveys, Questionnaires, Etc.

A Methodology Chapter For A Quantitative Study Explains The Following In A Direct And Precise Manner:

How Was The Data Generated? How Was It Processed? Why Was The Design, That Was Used, Used?

Any Methodology Chapter Must Be Written In The Past Tense And Follows The Following Guidelines: Chapter Provides Information On The Methods Of Data Collection To Enable The Readers To Understand The Process.

• Significance Of The Methodology Is That A Proper Methodology Validates The Study As A Whole.
• Methodology Section Should Provide A Rationale For Choosing A Particular Design.
• Methods Used Must Be Valid And Conforming To The Conventional Norms Of Research. As Such, The Methodology Chapter Must Provide Enough Evidence To Support The Credibility Of Each Method Used.
• The Appropriateness Of The Methods Chosen Must Be Stated. Only The Methods That Are Appropriate To The Scale Of The Subject In Investigation Must Be Chosen.
• The Chapter Must Contain Information On The Constraints And Challenges That Were Anticipated Before The Beginning Of The Study, The Steps Taken To Prevent The Problems From Occurring, And The Ways The Constraints That Did Occur Were Tackled With Minimal Impact And How The Said Impact Doesn’t Affect The Outcome Of The Study.
• Necessary Information To Replicate Any Particular Method Must Be Provided Concisely In The Chapter.

A methodology for a quantitative study begins with a reiteration of the research question and its context.

This is followed by the research design , where the methods used to gather, process and analyze the data are given. This is usually preceded or followed by a justification of the appropriateness of the research design . Then, the information on the pilot study is given. It is followed by the precise information on sampling strategies, instrument design, and methods of data analysis . ‘ Ethical considerations ’ comes next . Here the researcher informs the reader of the measures taken to ensure participants privacy and consent, etc. Penultimate to concluding the methodology chapter is problems and limitations, where the reader is informed of all the constraints the researcher anticipated and all the problems that occurred and the limitations methods may pose to the overall study.

Links, Related Posts

– indispensable qualitative research methods.

• Qualitative Research Design Methodology
• Quantitative Research Design Methodology
• Research Methodology Help
• Research Methodology Services

• A global market analysis (1)
• Academic (22)
• Algorithms (1)
• Big Data Analytics (4)
• Bio Statistics (3)
• Clinical Prediction Model (1)
• Corporate (9)
• Corporate statistics service (1)
• Data Analyses (23)
• Data collection (11)
• Genomics & Bioinformatics (1)
• Guidelines (2)
• Machine Learning – Blogs (1)
• Meta-analysis service (2)
• Network Analysis (1)
• Predictive analyses (2)
• Qualitative (1)
• Quantitaive (2)
• Quantitative Data analysis service (1)
• Research (59)
• Shipping & Logistics (1)
• Statistical analysis service (7)
• Statistical models (1)
• Statistical Report Writing (1)
• Statistical Software (10)
• Statistics (64)
• Survey & Interview from Statswork (1)
• Uncategorized (1)

Recent Posts

• Top 10 Machine Learning Algorithms Expected to Shape the Future of AI
• Data-Driven Governance: Revolutionizing State Youth Policies through Web Scraping
• The Future is Now: The Potential of Predictive Analytics Models and Algorithms
• 2024 Vision: Exploring the Impact and Evolution of Advanced Analytics Tools
• Application of machine learning in marketing

Statswork is a pioneer statistical consulting company providing full assistance to researchers and scholars. Statswork offers expert consulting assistance and enhancing researchers by our distinct statistical process and communication throughout the research process with us.

Functional Area

– Research Planning – Tool Development – Data Mining – Data Collection – Statistics Coursework – Research Methodology – Meta Analysis – Data Analysis

• – Corporate
• – Statistical Software
• – Statistics

Corporate Office

#10, Kutty Street, Nungambakkam, Chennai, Tamil Nadu – 600034, India No : +91 4433182000, UK No : +44-1223926607 , US No : +1-9725029262 Email: [email protected]

Website: www.statswork.com

© 2024 Statswork. All Rights Reserved

• QUICK LINKS
• How to enroll
• Career services

Understanding Q-Methodology: Bridging the Gap Between Qualitative and Quantitative Research

By  Stella Smith, Ph.D.

Introduction

Among the myriad of methodologies, Q-methodology stands out as a unique approach that offers a nuanced understanding of subjectivity while maintaining the rigor of quantitative analysis (Damio, 2016; Herrington & Coogan, 2011). On April 2nd, the Research Methodology Group hosted a webinar focused on Q-methodology Essentials. In this blog post, we delve into the essence of Q-methodology, exploring its principles, applications, and significance in contemporary research. We will end with some suggestions for how to learn more about Q-methodology.

Q-methodology

Seeks to uncover subjective viewpoints or perspectives on a particular topic by systematically analyzing individuals' rankings of statements or items

What is Q-Methodology?

Q-methodology, developed by British physicist and psychologist William Stephenson, is a research technique that combines elements of both qualitative and quantitative methodologies (Stephenson,1953). At its core, Q-methodology seeks to uncover subjective viewpoints or perspectives on a particular topic by systematically analyzing individuals' rankings of statements or items (Sandling, 2022; Van Exel & De Graaf, 2005). Unlike traditional surveys or interviews, which aim to capture consensus or frequency of responses, Q-methodology focuses on understanding the diversity of opinions within a given population.

Principles of Q-Methodology

Central to Q-methodology is the notion of "subjectivity" – recognizing that individuals interpret the world differently based on their unique experiences, beliefs, and values. The process typically involves three main steps:

Statement Generation: Researchers compile a set of statements or items relevant to the topic under study. These statements should cover a wide range of viewpoints and perspectives to capture the diversity within the population.

Q-Sorting: Participants are presented with the statements and asked to rank them according to their level of agreement or preference. This process, known as Q-sorting, requires participants to make subjective judgments about the statements based on their personal viewpoints.

Factor Analysis: The Q-sort data from multiple participants are then subjected to factor analysis, a statistical technique that identifies patterns or "factors" representing clusters of similar viewpoints. Through factor analysis, researchers can uncover underlying dimensions of opinion within the dataset.

Applications of Q-Methodology

Q-methodology has found applications across various disciplines, including psychology, sociology, political science, and market research. Some common areas of application include exploring subjective perceptions, understanding stakeholder perspectives and market segmentation.

Significance of Q-Methodology

What distinguishes Q-methodology is its ability to reconcile the richness of qualitative data with the rigor of quantitative analysis. By acknowledging the subjective nature of human perception while employing robust statistical techniques, Q-methodology offers a holistic approach to understanding complex social phenomena (Herrington & Coogan, 2011).

Moreover, Q-methodology provides a platform for amplifying marginalized voices and uncovering minority viewpoints that may be overlooked in traditional research approaches. By embracing diversity and embracing subjectivity, Q-methodology fosters a more inclusive and comprehensive understanding of the world around us.

Want to know more?

Check out the full webinar on Q-methodology which is uploaded to the  Research and Methodology Group Teams  site. 

Schedule an  office hours appointment  with a methodologist to discuss your Q-methodology design.

Review the  Qmethod  website and  Operant Subjectivity - The International Journal of Q Methodology

Damio, S. M. (2016). Q Methodology: An Overview and Steps to Implementation. Asian Journal of  University Education, 12(1), 105.

Herrington, N., &, Coogan, J. (2011). Q methodology: an overview. Research in Teacher   Education, 1(2), 24-28.

Sandling, J. (2022). Q Methodology: Complete Beginner’s Guide. Available at   https://jonathansandling.com/q-methodology-complete-beginners-guide/

Stephenson W. The study of behavior: Q-technique and its methodology. Chicago: University of Chicago Press. 1953

Van Exel, J., & De Graaf, G. (2005). Q methodology: A sneak preview. Available at https://www.betterevaluation.org/tools-resources/q-methodology-sneak-preview

Stella Smith, Ph.D.

ABOUT THE AUTHOR

Dr. Stella Smith serves as the Associate University Research Chair for Center for Educational and Instructional Technology Research (CEITR).  She is also an Assistant Professor of Qualitative Research at Prairie View A&M University. A qualitative researcher, Dr. Stella Smith's scholarly interests focus on the experiences of  African American females in leadership in higher education; diversity, equity and inclusion of underserved populations in higher education, and P–20 educational pipeline alignment.  Dr. Smith is a strong advocate for social justice and passionate about creating asset based pathways of success for underserved students.

Dr. Smith was recognized with a 2014 Dissertation Award from the American Association of Blacks in Higher Education and as part of the 2019 class of 35 Outstanding Women Leaders in Higher Education by Diverse Issues in Higher Education. Dr. Smith earned her PhD in Educational Administration with a portfolio in Women and Gender Studies from The University of Texas at Austin.

More from Author Name

Research Methodology Group Office Hours: Your Guide to Productive Consultations

Numbers, Facts and Trends Shaping Your World

Read our research on:

Full Topic List

Regions & Countries

• Publications
• Our Methods
• Short Reads
• Tools & Resources

Read Our Research On:

Writing Survey Questions

Perhaps the most important part of the survey process is the creation of questions that accurately measure the opinions, experiences and behaviors of the public. Accurate random sampling will be wasted if the information gathered is built on a shaky foundation of ambiguous or biased questions. Creating good measures involves both writing good questions and organizing them to form the questionnaire.

Questionnaire design is a multistage process that requires attention to many details at once. Designing the questionnaire is complicated because surveys can ask about topics in varying degrees of detail, questions can be asked in different ways, and questions asked earlier in a survey may influence how people respond to later questions. Researchers are also often interested in measuring change over time and therefore must be attentive to how opinions or behaviors have been measured in prior surveys.

Surveyors may conduct pilot tests or focus groups in the early stages of questionnaire development in order to better understand how people think about an issue or comprehend a question. Pretesting a survey is an essential step in the questionnaire design process to evaluate how people respond to the overall questionnaire and specific questions, especially when questions are being introduced for the first time.

For many years, surveyors approached questionnaire design as an art, but substantial research over the past forty years has demonstrated that there is a lot of science involved in crafting a good survey questionnaire. Here, we discuss the pitfalls and best practices of designing questionnaires.

Question development

There are several steps involved in developing a survey questionnaire. The first is identifying what topics will be covered in the survey. For Pew Research Center surveys, this involves thinking about what is happening in our nation and the world and what will be relevant to the public, policymakers and the media. We also track opinion on a variety of issues over time so we often ensure that we update these trends on a regular basis to better understand whether people’s opinions are changing.

At Pew Research Center, questionnaire development is a collaborative and iterative process where staff meet to discuss drafts of the questionnaire several times over the course of its development. We frequently test new survey questions ahead of time through qualitative research methods such as  focus groups , cognitive interviews, pretesting (often using an  online, opt-in sample ), or a combination of these approaches. Researchers use insights from this testing to refine questions before they are asked in a production survey, such as on the ATP.

Measuring change over time

Many surveyors want to track changes over time in people’s attitudes, opinions and behaviors. To measure change, questions are asked at two or more points in time. A cross-sectional design surveys different people in the same population at multiple points in time. A panel, such as the ATP, surveys the same people over time. However, it is common for the set of people in survey panels to change over time as new panelists are added and some prior panelists drop out. Many of the questions in Pew Research Center surveys have been asked in prior polls. Asking the same questions at different points in time allows us to report on changes in the overall views of the general public (or a subset of the public, such as registered voters, men or Black Americans), or what we call “trending the data”.

When measuring change over time, it is important to use the same question wording and to be sensitive to where the question is asked in the questionnaire to maintain a similar context as when the question was asked previously (see  question wording  and  question order  for further information). All of our survey reports include a topline questionnaire that provides the exact question wording and sequencing, along with results from the current survey and previous surveys in which we asked the question.

The Center’s transition from conducting U.S. surveys by live telephone interviewing to an online panel (around 2014 to 2020) complicated some opinion trends, but not others. Opinion trends that ask about sensitive topics (e.g., personal finances or attending religious services ) or that elicited volunteered answers (e.g., “neither” or “don’t know”) over the phone tended to show larger differences than other trends when shifting from phone polls to the online ATP. The Center adopted several strategies for coping with changes to data trends that may be related to this change in methodology. If there is evidence suggesting that a change in a trend stems from switching from phone to online measurement, Center reports flag that possibility for readers to try to head off confusion or erroneous conclusions.

Open- and closed-ended questions

One of the most significant decisions that can affect how people answer questions is whether the question is posed as an open-ended question, where respondents provide a response in their own words, or a closed-ended question, where they are asked to choose from a list of answer choices.

For example, in a poll conducted after the 2008 presidential election, people responded very differently to two versions of the question: “What one issue mattered most to you in deciding how you voted for president?” One was closed-ended and the other open-ended. In the closed-ended version, respondents were provided five options and could volunteer an option not on the list.

When explicitly offered the economy as a response, more than half of respondents (58%) chose this answer; only 35% of those who responded to the open-ended version volunteered the economy. Moreover, among those asked the closed-ended version, fewer than one-in-ten (8%) provided a response other than the five they were read. By contrast, fully 43% of those asked the open-ended version provided a response not listed in the closed-ended version of the question. All of the other issues were chosen at least slightly more often when explicitly offered in the closed-ended version than in the open-ended version. (Also see  “High Marks for the Campaign, a High Bar for Obama”  for more information.)

Researchers will sometimes conduct a pilot study using open-ended questions to discover which answers are most common. They will then develop closed-ended questions based off that pilot study that include the most common responses as answer choices. In this way, the questions may better reflect what the public is thinking, how they view a particular issue, or bring certain issues to light that the researchers may not have been aware of.

When asking closed-ended questions, the choice of options provided, how each option is described, the number of response options offered, and the order in which options are read can all influence how people respond. One example of the impact of how categories are defined can be found in a Pew Research Center poll conducted in January 2002. When half of the sample was asked whether it was “more important for President Bush to focus on domestic policy or foreign policy,” 52% chose domestic policy while only 34% said foreign policy. When the category “foreign policy” was narrowed to a specific aspect – “the war on terrorism” – far more people chose it; only 33% chose domestic policy while 52% chose the war on terrorism.

In most circumstances, the number of answer choices should be kept to a relatively small number – just four or perhaps five at most – especially in telephone surveys. Psychological research indicates that people have a hard time keeping more than this number of choices in mind at one time. When the question is asking about an objective fact and/or demographics, such as the religious affiliation of the respondent, more categories can be used. In fact, they are encouraged to ensure inclusivity. For example, Pew Research Center’s standard religion questions include more than 12 different categories, beginning with the most common affiliations (Protestant and Catholic). Most respondents have no trouble with this question because they can expect to see their religious group within that list in a self-administered survey.

In addition to the number and choice of response options offered, the order of answer categories can influence how people respond to closed-ended questions. Research suggests that in telephone surveys respondents more frequently choose items heard later in a list (a “recency effect”), and in self-administered surveys, they tend to choose items at the top of the list (a “primacy” effect).

Because of concerns about the effects of category order on responses to closed-ended questions, many sets of response options in Pew Research Center’s surveys are programmed to be randomized to ensure that the options are not asked in the same order for each respondent. Rotating or randomizing means that questions or items in a list are not asked in the same order to each respondent. Answers to questions are sometimes affected by questions that precede them. By presenting questions in a different order to each respondent, we ensure that each question gets asked in the same context as every other question the same number of times (e.g., first, last or any position in between). This does not eliminate the potential impact of previous questions on the current question, but it does ensure that this bias is spread randomly across all of the questions or items in the list. For instance, in the example discussed above about what issue mattered most in people’s vote, the order of the five issues in the closed-ended version of the question was randomized so that no one issue appeared early or late in the list for all respondents. Randomization of response items does not eliminate order effects, but it does ensure that this type of bias is spread randomly.

Questions with ordinal response categories – those with an underlying order (e.g., excellent, good, only fair, poor OR very favorable, mostly favorable, mostly unfavorable, very unfavorable) – are generally not randomized because the order of the categories conveys important information to help respondents answer the question. Generally, these types of scales should be presented in order so respondents can easily place their responses along the continuum, but the order can be reversed for some respondents. For example, in one of Pew Research Center’s questions about abortion, half of the sample is asked whether abortion should be “legal in all cases, legal in most cases, illegal in most cases, illegal in all cases,” while the other half of the sample is asked the same question with the response categories read in reverse order, starting with “illegal in all cases.” Again, reversing the order does not eliminate the recency effect but distributes it randomly across the population.

Question wording

The choice of words and phrases in a question is critical in expressing the meaning and intent of the question to the respondent and ensuring that all respondents interpret the question the same way. Even small wording differences can substantially affect the answers people provide.

[View more Methods 101 Videos ]

An example of a wording difference that had a significant impact on responses comes from a January 2003 Pew Research Center survey. When people were asked whether they would “favor or oppose taking military action in Iraq to end Saddam Hussein’s rule,” 68% said they favored military action while 25% said they opposed military action. However, when asked whether they would “favor or oppose taking military action in Iraq to end Saddam Hussein’s rule  even if it meant that U.S. forces might suffer thousands of casualties, ” responses were dramatically different; only 43% said they favored military action, while 48% said they opposed it. The introduction of U.S. casualties altered the context of the question and influenced whether people favored or opposed military action in Iraq.

There has been a substantial amount of research to gauge the impact of different ways of asking questions and how to minimize differences in the way respondents interpret what is being asked. The issues related to question wording are more numerous than can be treated adequately in this short space, but below are a few of the important things to consider:

First, it is important to ask questions that are clear and specific and that each respondent will be able to answer. If a question is open-ended, it should be evident to respondents that they can answer in their own words and what type of response they should provide (an issue or problem, a month, number of days, etc.). Closed-ended questions should include all reasonable responses (i.e., the list of options is exhaustive) and the response categories should not overlap (i.e., response options should be mutually exclusive). Further, it is important to discern when it is best to use forced-choice close-ended questions (often denoted with a radio button in online surveys) versus “select-all-that-apply” lists (or check-all boxes). A 2019 Center study found that forced-choice questions tend to yield more accurate responses, especially for sensitive questions.  Based on that research, the Center generally avoids using select-all-that-apply questions.

It is also important to ask only one question at a time. Questions that ask respondents to evaluate more than one concept (known as double-barreled questions) – such as “How much confidence do you have in President Obama to handle domestic and foreign policy?” – are difficult for respondents to answer and often lead to responses that are difficult to interpret. In this example, it would be more effective to ask two separate questions, one about domestic policy and another about foreign policy.

In general, questions that use simple and concrete language are more easily understood by respondents. It is especially important to consider the education level of the survey population when thinking about how easy it will be for respondents to interpret and answer a question. Double negatives (e.g., do you favor or oppose  not  allowing gays and lesbians to legally marry) or unfamiliar abbreviations or jargon (e.g., ANWR instead of Arctic National Wildlife Refuge) can result in respondent confusion and should be avoided.

Similarly, it is important to consider whether certain words may be viewed as biased or potentially offensive to some respondents, as well as the emotional reaction that some words may provoke. For example, in a 2005 Pew Research Center survey, 51% of respondents said they favored “making it legal for doctors to give terminally ill patients the means to end their lives,” but only 44% said they favored “making it legal for doctors to assist terminally ill patients in committing suicide.” Although both versions of the question are asking about the same thing, the reaction of respondents was different. In another example, respondents have reacted differently to questions using the word “welfare” as opposed to the more generic “assistance to the poor.” Several experiments have shown that there is much greater public support for expanding “assistance to the poor” than for expanding “welfare.”

We often write two versions of a question and ask half of the survey sample one version of the question and the other half the second version. Thus, we say we have two  forms  of the questionnaire. Respondents are assigned randomly to receive either form, so we can assume that the two groups of respondents are essentially identical. On questions where two versions are used, significant differences in the answers between the two forms tell us that the difference is a result of the way we worded the two versions.

One of the most common formats used in survey questions is the “agree-disagree” format. In this type of question, respondents are asked whether they agree or disagree with a particular statement. Research has shown that, compared with the better educated and better informed, less educated and less informed respondents have a greater tendency to agree with such statements. This is sometimes called an “acquiescence bias” (since some kinds of respondents are more likely to acquiesce to the assertion than are others). This behavior is even more pronounced when there’s an interviewer present, rather than when the survey is self-administered. A better practice is to offer respondents a choice between alternative statements. A Pew Research Center experiment with one of its routinely asked values questions illustrates the difference that question format can make. Not only does the forced choice format yield a very different result overall from the agree-disagree format, but the pattern of answers between respondents with more or less formal education also tends to be very different.

One other challenge in developing questionnaires is what is called “social desirability bias.” People have a natural tendency to want to be accepted and liked, and this may lead people to provide inaccurate answers to questions that deal with sensitive subjects. Research has shown that respondents understate alcohol and drug use, tax evasion and racial bias. They also may overstate church attendance, charitable contributions and the likelihood that they will vote in an election. Researchers attempt to account for this potential bias in crafting questions about these topics. For instance, when Pew Research Center surveys ask about past voting behavior, it is important to note that circumstances may have prevented the respondent from voting: “In the 2012 presidential election between Barack Obama and Mitt Romney, did things come up that kept you from voting, or did you happen to vote?” The choice of response options can also make it easier for people to be honest. For example, a question about church attendance might include three of six response options that indicate infrequent attendance. Research has also shown that social desirability bias can be greater when an interviewer is present (e.g., telephone and face-to-face surveys) than when respondents complete the survey themselves (e.g., paper and web surveys).

Lastly, because slight modifications in question wording can affect responses, identical question wording should be used when the intention is to compare results to those from earlier surveys. Similarly, because question wording and responses can vary based on the mode used to survey respondents, researchers should carefully evaluate the likely effects on trend measurements if a different survey mode will be used to assess change in opinion over time.

Question order

Once the survey questions are developed, particular attention should be paid to how they are ordered in the questionnaire. Surveyors must be attentive to how questions early in a questionnaire may have unintended effects on how respondents answer subsequent questions. Researchers have demonstrated that the order in which questions are asked can influence how people respond; earlier questions can unintentionally provide context for the questions that follow (these effects are called “order effects”).

One kind of order effect can be seen in responses to open-ended questions. Pew Research Center surveys generally ask open-ended questions about national problems, opinions about leaders and similar topics near the beginning of the questionnaire. If closed-ended questions that relate to the topic are placed before the open-ended question, respondents are much more likely to mention concepts or considerations raised in those earlier questions when responding to the open-ended question.

For closed-ended opinion questions, there are two main types of order effects: contrast effects ( where the order results in greater differences in responses), and assimilation effects (where responses are more similar as a result of their order).

An example of a contrast effect can be seen in a Pew Research Center poll conducted in October 2003, a dozen years before same-sex marriage was legalized in the U.S. That poll found that people were more likely to favor allowing gays and lesbians to enter into legal agreements that give them the same rights as married couples when this question was asked after one about whether they favored or opposed allowing gays and lesbians to marry (45% favored legal agreements when asked after the marriage question, but 37% favored legal agreements without the immediate preceding context of a question about same-sex marriage). Responses to the question about same-sex marriage, meanwhile, were not significantly affected by its placement before or after the legal agreements question.

Another experiment embedded in a December 2008 Pew Research Center poll also resulted in a contrast effect. When people were asked “All in all, are you satisfied or dissatisfied with the way things are going in this country today?” immediately after having been asked “Do you approve or disapprove of the way George W. Bush is handling his job as president?”; 88% said they were dissatisfied, compared with only 78% without the context of the prior question.

Responses to presidential approval remained relatively unchanged whether national satisfaction was asked before or after it. A similar finding occurred in December 2004 when both satisfaction and presidential approval were much higher (57% were dissatisfied when Bush approval was asked first vs. 51% when general satisfaction was asked first).

Several studies also have shown that asking a more specific question before a more general question (e.g., asking about happiness with one’s marriage before asking about one’s overall happiness) can result in a contrast effect. Although some exceptions have been found, people tend to avoid redundancy by excluding the more specific question from the general rating.

Assimilation effects occur when responses to two questions are more consistent or closer together because of their placement in the questionnaire. We found an example of an assimilation effect in a Pew Research Center poll conducted in November 2008 when we asked whether Republican leaders should work with Obama or stand up to him on important issues and whether Democratic leaders should work with Republican leaders or stand up to them on important issues. People were more likely to say that Republican leaders should work with Obama when the question was preceded by the one asking what Democratic leaders should do in working with Republican leaders (81% vs. 66%). However, when people were first asked about Republican leaders working with Obama, fewer said that Democratic leaders should work with Republican leaders (71% vs. 82%).

The order questions are asked is of particular importance when tracking trends over time. As a result, care should be taken to ensure that the context is similar each time a question is asked. Modifying the context of the question could call into question any observed changes over time (see  measuring change over time  for more information).

A questionnaire, like a conversation, should be grouped by topic and unfold in a logical order. It is often helpful to begin the survey with simple questions that respondents will find interesting and engaging. Throughout the survey, an effort should be made to keep the survey interesting and not overburden respondents with several difficult questions right after one another. Demographic questions such as income, education or age should not be asked near the beginning of a survey unless they are needed to determine eligibility for the survey or for routing respondents through particular sections of the questionnaire. Even then, it is best to precede such items with more interesting and engaging questions. One virtue of survey panels like the ATP is that demographic questions usually only need to be asked once a year, not in each survey.

U.S. Surveys

Other research methods, sign up for our weekly newsletter.

Fresh data delivered Saturday mornings

1615 L St. NW, Suite 800 Washington, DC 20036 USA (+1) 202-419-4300 | Main (+1) 202-857-8562 | Fax (+1) 202-419-4372 |  Media Inquiries

Research Topics

• Age & Generations
• Coronavirus (COVID-19)
• Economy & Work
• Family & Relationships
• Gender & LGBTQ
• Immigration & Migration
• International Affairs
• Internet & Technology
• Methodological Research
• News Habits & Media
• Non-U.S. Governments
• Other Topics
• Politics & Policy
• Race & Ethnicity
• Email Newsletters

ABOUT PEW RESEARCH CENTER  Pew Research Center is a nonpartisan fact tank that informs the public about the issues, attitudes and trends shaping the world. It conducts public opinion polling, demographic research, media content analysis and other empirical social science research. Pew Research Center does not take policy positions. It is a subsidiary of  The Pew Charitable Trusts .

Copyright 2024 Pew Research Center

Terms & Conditions

Privacy Policy

Cookie Settings

Reprints, Permissions & Use Policy