What is Validity?
Validity refers to whether a measurement system actually measures what it is supposed to measure. It asks the question: "Is this data relevant?" For your RBT practice test, think of validity as "Truth." Does the data tell the truth about the behavior?
A classic example of invalid measurement: trying to measure a client's intelligence by measuring the size of their head. You might measure the head very accurately (reliability), but the number tells you nothing about intelligence. The data is invalid.
On the RBT Practice Exam, validity scenarios usually involve measuring the wrong dimension. For example, using "Frequency" to measure "Tantrum Duration." Knowing how many times they screamed doesn't tell you how long they screamed. It lacks validity for that specific dimension.
Threats to Validity
Indirect Measurement: Asking a parent "How many times did he hit?" is often invalid because memory is flawed. Direct measurement is always more valid.
Poor Operational Definitions: If your definition of "Aggression" includes "Thinking bad thoughts," your data will be invalid because you cannot see thoughts. The data becomes a guess.
Clinical Applications
We ensure validity by picking the right measurement system. If the goal is "Complete math work," then Permanent Product is a valid measure. If the goal is "Socialize with peers," Duration might be more valid than Frequency.
Social Validity is a huge concept. This asks: "Does this behavior change actually matter to the client's life?" Teaching a 25-year-old to stack blocks might be "successful" on a graph, but it has low social validity. Teaching them to do laundry has high social validity.
Reliability vs. Validity
This is the classic mix-up. Reliability is consistency. Validity is accuracy/relevance.
- Reliable but Invalid: A scale that is always 10lbs off. It consistently gives the wrong weight.
- Valid but Unreliable: A scale that is right sometimes but breaks often.
RBT Practice Exam Tips for Validity
Look for questions about "Social Significance." If the question asks why we teach functional communication instead of nonsense words, the answer is usually related to Social Validity.
If the RBT is recording data on the wrong child, that is a validity problem (and a reliability problem!). But usually, validity is about the relevance of the data to the goal.
Professional Judgment
As an RBT, you are the first line of defense for validity. If you realize a definition doesn't make sense ("The BCBA wants me to count eye contact, but the kid is wearing sunglasses"), speak up.
Collecting invalid data is unethical. It leads to decisions based on false premises. If the data says the child is "cured" but they are still struggling at home, the data lacks validity.
Always ask yourself: "Does this number on my tablet actually represent what just happened?" If not, talk to your supervisor.
Frequently Asked Questions About Validity
What is the simple definition of Validity?
It means "measuring the right thing." Does the data correspond to the actual phenomenon you are trying to track?
What is Reliability vs. Validity?
Reliability is Consistency (getting the same score twice). Validity is Accuracy (getting the score that reflects reality).
What is Social Validity?
The extent to which the target behaviors are appropriate, acceptable, and significant to the client and society. "Is this goal worth achieving?"
Can data be Reliable but Invalid?
Yes. If I measure your height to determine your math skills, I can get a very reliable height measurement every day, but it is totally invalid for judging math skills.
What is Internal Validity?
This usually refers to experiments. Did the intervention cause the change, or was it something else (like the child just got older)? High internal validity means the intervention worked.
What is External Validity?
Can the results be generalized? If a stratgy works in the clinic (internal validity), will it work at school (external validity)?
How do Operational Definitions affect validity?
A bad definition forces you to collect bad data. If the definition is vague, the data you collect won't represent the actual behavior, making it invalid.
Is "asking the teacher" a valid way to collect data?
Usually, no. Indirect measurement (surveys/interviews) is less valid than Direct Measurement because memories are biased.
Why is Validity important for ethics?
Because making life-changing decisions based on invalid data is harmful. We must base treatments on truth.
What measurement system has the highest validity for "Duration"?
Total Duration recording. Using "Frequency" to guess duration is invalid.
Is this on the RBT exam?
Yes. Expect questions that describe a measurement scenario and ask if it is valid or reliable. Usually, if they measure the wrong dimension, it's a validity issue.
What is "Artifact" in measurement?
A misleading data point. For example, checking "Partial Interval" makes it look like behavior happened 100% of the time, when it was only 10%. That overestimation is a "measurement artifact" affecting validity.