The Road to Successful Research Requires
Research Measurement Validity and Reliability
Validity Analytics provides database design, data analysis and validation support with Independent and Confidential Statistical Support to Qualitative and Quantitative Studies
Why You need improved analysis, Validity and Reliability for your data, survey or research findings
Lower Costs, Improvement of Data, Surveys and Audit Processes.
Regulatory agencies program evaluators, and audit companies have a responsibility to answer questions that can be asked about the costs, validity and reliability of their standards, data, system and audit processes.
If program audits are effective, the focus of the audit (e.g. eucational progress) should show demonstrable improvement or reduction in the domain being measured.
Example Number 1: Educational System SurveysGraduate attitudes towards their external degree programsLocal business community educational prioritiesFaculty ratings of high school preparation for admissionsStudent educational program perspectivesFaculty views of administrative competenciesPost graduate employmentUnmarried female and male attitudes towards abortionPerceptions towards immigrantsAttitudes toward veteran assistance programsCampus acceptance of LGBTQ students
Example Number 2The government wants to develop an overall integrated system that measures educational progress from the federal, srate and local levels. However, all three levels of government use hundreds of different audit standards, different audit questions and different methods to collect the data. The feds want a nation-wide measure as required by congress but the data coming from hundreds of independent federal, state and city audits and thousands of auditors are incompatable.
A validity and reliability study of all three educational project audit levels can be used to more clearly focus all three levels of analysis faster at vastly lower costs with vastly higher levels of validity and reliability.
The results are higher and more precise standards and processes that can be used to guide ducational or governmental levels and report more focused and accurate results to funding agencies. How are audits and the educational system being served and improved? How about OSHA audits? Or hospital audits? Or pharmaceutical audits? Restaurant/Cafeteria sanitation audits? Accounting audits? Quality Audits?
Example Number 2The government wants to develop an overall integrated system that measures educational progress from the federal, srate and local levels. However, all three levels of government use hundreds of different audit standards, different audit questions and different methods to collect the data. The feds want a nation-wide measure as required by congress but the data coming from hundreds of independent federal, state and city audits and thousands of auditors are incompatable.
A validity and reliability study of all three educational project audit levels can be used to more clearly focus all three levels of analysis faster at vastly lower costs with vastly higher levels of validity and reliability.
The results are higher and more precise standards and processes that can be used to guide ducational or governmental levels and report more focused and accurate results to funding agencies. How are audits and the educational system being served and improved? How about OSHA audits? Or hospital audits? Or pharmaceutical audits? Restaurant/Cafeteria sanitation audits? Accounting audits? Quality Audits?
Pre-Study Analysis and correction of survey or Study questions
Analysis of Data, Content, Construct and Criterion Validity
Homogeneity (Factor Analysis to redefine domains)
Theory Evidence (Related Research)
Validity
Survey Reviews and Results
Were the questions validly constructed?Was the sample valid?Was the collection of data validly executed?Was the surveyor`s assumption of constructs valid?Was the interpretation of results valid?
Validity is defined as the extent to which a concept is accurately measured in a quantitative study.
Face ValidityContent ValidityCriterion ValidityDiscriminant Validity
Reliability
Test-retestInternal Consistency Split-half Cronbach’s alphaInter-rater reliabilityQuality Control: Statistical Process Control (Process Reliability)Failure RatesMean Time to Failure
Audit Data Validity
- 1. Validating Your Preventive Control Plan with Teams and SPC 2. Certification audit data with globally accepted benchmarked schemes (such as Primus Labs, BRCGS and SQF, International HACCP, ISO, and Others.) 3. Validity of Company Data Environmental Sampling Supplier Controls Audit Consistency Transportation Controls Import/Export
Technical Validity and Reliability
1. Factor Analysis Applied to Obtaining Validity and Reliability Evidence for Student Evaluation Forms
2. Assessing Factors Contributing to Food Safety Culture in Retail Food Establishments
3. Survey Monkey
4. Political
5. Health Care and Records Accuracy
6. Immigration
7. Guns
8. Education
9. Abortion
10. Planned Parenthood
11. Diet
12. Alcohol
13. Exercise
14. Obesity
15. Affordable Care
16. Insurance
17. Environment
18. Human Resources
19. Event Evaluation
20. Job Satisfaction
Some of our tools
• Histograms and Frequency Distributions• Charts and Trends• Cumulative Frequency Functions• Probability Density Functions• Sample Estimates of Population Parameters• Means and Standard Deviations
• Test-retest reliability• Inter-rater reliability• Correlational Analysis• Split-half correlation• Cronbach’s alpha• Weibull• Kuder-Richardson Coefficient• Item choice distributions
• Weibull goodness of fit• Factor Analysiso Principal Componentso Varimax o Primary Pattern• Failure Rates• Mean Time to Failure
Tell Us How we can help
Use the form above or our email address (info@validityanalytics.com) or phone number (386 837-7375) to contact us and tell us about your study.
Option 1: Basic Review and Help Services
We will request your research or survey questions or study problems and your data.
We recommend that we review your project status prior to administering any tests or survey and can also help define the correct reliability study data collection methods.
We will provide a cost estimate for our work.
Option 2: Advanced Domain Validity Studies
We will look at your data and study problem or survey questions and recommend the correct approach to a factor analysis validity or reliability improvement.
We will provide a cost estimate for our work.
We will analyze your data using our tools and will write a summary report that will outline what changes you should consider making.
A full technical report is also available. Review our sample report at validityanalytics.com/abstract
All data, analysis and reporting are confidential.
Contact Us today
We are privately owned, operate out of Ohio and will happily sign non-disclosure agreements (NDA's)