Skip to main content

In his new white paper, Managing Director Dr. David Tabak examines a form of p-hacking, or making various attempts to obtain a statistically significant or insignificant result, in which an expert examines different event-window lengths in an event study. A failure to account for the examination of multiple potential event windows can lead to incorrect assessments of the statistical significance of a security’s price movement.

Evidence of event-window p-hacking can be shown by an unjustified lack of consistency of methodologies to determine event-window lengths in an expert’s previous analyses or within the current case. Dr. Tabak provides empirical evidence regarding how unaccounted-for choices in the length of an event window can affect the measurement of statistical significance. Dr. Tabak also explains that while there may sometimes be a reason to deviate from a standard methodology, there should be a high burden to show that the deviation is theoretically justified and not designed for the purpose of achieving certain results.

Download Publication

GENERAL DISCLAIMER

© 20[xx] S&P Dow Jones Indices. All rights reserved. Redistribution or reproduction in whole or in part is prohibited without written permission. S&P, S&P 500, US 500, The 500, iBoxx, CDX, iTraxx are trademarks of S&P Global, Inc. or its affiliates; DOW JONES is a registered trademark of Dow Jones Trademark Holdings LLC; and these trademarks have been licensed to S&P Dow Jones Indices; and these trademarks have been licensed to S&P Dow Jones Indices. S&P Dow Jones Indices LLC, Dow Jones, S&P and their respective affiliates (“S&P Dow Jones Indices”) and third party licensors makes no representation or warranty, express or implied, as to the ability of any index to accurately represent the asset class or market sector that it purports to represent and S&P Dow Jones Indices and its third party licensors shall have no liability for any errors, omissions, or interruptions of any index or the data included therein. Past performance of an index is not an indication or guarantee of future results. This document does not constitute an offer of any services. Except for certain custom index calculation services, all information provided by S&P Dow Jones Indices is general in nature and not tailored to the needs of any person, entity or group of persons. S&P Dow Jones Indices receives compensation in connection with licensing its indices to third parties and providing custom calculation services. It is not possible to invest directly in an index. Exposure to an asset class represented by an index may be available through investable instruments offered by third parties that are based on that index. S&P Dow Jones Indices does not sponsor, endorse, sell, promote or manage any investment fund or other investment product or vehicle that seeks to provide an investment return based on the performance of any Index . S&P Dow Jones Indices LLC is not an investment or tax advisor. S&P Dow Jones Indices makes no representation regarding the advisability of investing in any such investment fund or other investment product or vehicle. A tax advisor should be consulted to evaluate the impact of any tax-exempt securities on portfolios and the tax consequences of making any particular investment decision. Credit-related information and other analyses, including ratings, are generally provided by licensors and/or affiliates of S&P Dow Jones Indices. Any credit-related information and other related analyses and statements are opinions as of the date they are expressed and are not statements of fact. S&P Dow Jones Indices LLC is analytically separate and independent from any other analytical department. For more information on any of our indices please visit www.spglobal.com/spdji.