BAD SCIENCE: MISAPPLICATIONS IN ANALYTICAL CHEMISTRY

Overview:
In today’s technical landscape, exaggerated claims and misrepresented data are prevalent. While a background in chemistry aids in critically assessing such claims, logical reasoning is often sufficient to discern the truth. “Bad science” often involves misapplying sound principles to make flawed arguments appear valid. At our company, we are degreed and experienced analytical chemists, and we frequently encounter misleading or inaccurate scientific claims in sales literature and technical specifications. This section aims to guide you in recognizing these pitfalls and avoiding unsubstantiated claims in analytical practices.

Detection Limits, Accuracy, and Precision

Some laboratories emphasize their detection capabilities with extensive descriptions of methodologies like confidence intervals, uncertainty modeling, and statistical calculations. While these techniques can appear robust, their application must be critically assessed.

For instance, one lab claims it can detect 0.024 mg/m³ of oil mist and particulate in air samples. On the surface, this seems impressive. However, this equates to accurately measuring 24 micrograms of debris in a 1 cubic meter air sample—equivalent to 0.04 microliters of oil, an amount so minuscule it’s virtually invisible to the naked eye. While microbalances can theoretically detect such minute amounts, this ignores significant variables, including sampling hardware design, filter handling, and environmental factors. Claims like these often reflect theoretical calculations rather than demonstrated performance.

Quality Assurance in Practice

Accreditations such as those from AIHA or A2LA require laboratories to develop and implement quality assurance (QA) manuals. However, compliance varies widely.

For example, one medium-sized lab copied a QA manual from another company to meet accreditation requirements, despite it being irrelevant to their operations. Another case revealed a large, reputable lab reporting clean air (<0.2 mg/m³ of oil mist + particulate) for a sample deliberately contaminated with 8.0 mg/m³ of oil mist. This discrepancy highlighted shortcuts in their processes—filters were not weighed unless they visibly appeared dirty.

Such practices underscore the importance of not only having QA systems in place but ensuring their consistent and accurate application in daily operations.

Particle Size Specifications: A Flawed Standard

Specifications for oxygen-compatible air often include particulate size limits (e.g., 1 micron or 2 microns) without specifying acceptable quantities or types of particles. This ambiguity reduces the reliability of such standards, especially when applied outside controlled environments like cleanrooms.

In real-world scenarios—such as dive shops or military applications—achieving precise particle size measurements is impractical. Challenges include the need for high-magnification microscopy (e.g., 100x), the influence of environmental contamination, and variability in sampling equipment. Even statistical counting methods, which aim to reduce testing costs, are unreliable due to non-uniform airflow across filters.

To address these limitations, adopting more practical standards, such as the U.S. Navy’s specifications for oxygen-compatible air, provides a more reliable and realistic framework.

Expertise in Air Sampling and Analysis

True expertise in air sampling and analysis requires extensive field and laboratory experience. While many professionals claim expertise, genuine proficiency is rare and demands:

• Hands-on experience in challenging environments, such as submarine engine rooms or crowded dive boats.
• Practical understanding of compressor operations and the ability to diagnose failures.
• Familiarity with diverse air sampling kits and their performance under varying conditions.
• Comprehensive research and method validation in laboratory settings.

Effective analysis goes beyond theoretical knowledge—it requires practical problem-solving and an in-depth understanding of real-world variables affecting air quality assessments.

By critically examining claims and standards, industry professionals can make informed decisions, ensuring quality and accuracy in air sampling and analysis. Avoid the pitfalls of “bad science” by relying on proven methodologies, realistic standards, and genuine expertise.