Data Integrity Reports
Show [+] Announcement
Effective May 1, 2013 NYSDOH Title 10 New York Codes Rules and Regulations (NYCRR) Sections 405.2 and 405.4 were amended to require that hospitals have in place evidence-based protocols for the early recognition and treatment of patients with severe sepsis and septic shock that are based on generally accepted standards of care. Consistent with these regulations, sepsis protocols were submitted by all Article 28 hospitals with implementation by hospitals on or before December 31, 2013. In addition, subdivision 7 (i, ii) specified that “medical staff shall be responsible for the collection, use, and reporting of quality measures related to the recognition and treatment of severe sepsis for purposes of internal quality improvement and hospital reporting to the Department."
In response to these amendments, hospitals are responsible for reporting severe sepsis and septic shock cases by quarterly data upload via the New York Sepsis Data Collection web portal at https://ny.sepsis.ipro.org. To help ensure that the data set, which will ultimately be used for public reporting of hospital performance, is both accurate and complete, the Department of Health and IPRO have created a survey for facilities to describe how they identify severe sepsis and septic shock cases. We have been encouraging hospitals to use any and all methods for identification of severe sepsis and septic shock patients from their facilities. Ideal approaches for case finding include prospective and retrospective, clinical and administrative data sources. Significant variation in methodologies for case identification may help explain both data integrity findings as well as measure differences unrelated to actual performance. The Department is requesting that each facility complete the survey regarding use of definitions and case finding methodologies in your institution(s). Please coordinate within your hospital and submit a single survey for your hospital. If you are part of a hospital system, each distinct hospital within the system should complete the survey for their hospital. The survey is available at https://www.surveymonkey.com/s/2YLCXYJ. Surveys must be complete by May 29, 2015.
The Department will use a variety of methods to authenticate the integrity of the data and to support hospitals in their data reporting efforts. We have created Data Integrity Reports analyzing the severe sepsis and septic shock cases reported through the data submission portal compared to SPARCS. We are providing each facility with four reports of findings based on the comparison of your SPARCS data submission with the severe sepsis/septic shock clinical data set. A description of each report as well as instructions for access to the reports is available at https://ny.sepsis.ipro.org/data_integrity_reports. Hospitals will need to register to download these reports. Each hospital is required to evaluate these reports and complete the column in the spreadsheet indicating the reason for the mismatch of the data between SPARCS and the reported Severe Sepsis/Septic Shock data. The Data Integrity Report response from hospitals will be due by June 30, 2015. A training session will be provided on May 11, 2015 at 11am to go through the reports and the expected follow-up. We will also view sample reports and address download and upload questions, as well as provide detail on the expected responses within the spreadsheet. Please register for the webinar at https://iproevents.webex.com/iproevents/onstage/g.php?d=660545492&t=a.
In follow-up to the reports, it is our expectation that hospitals will take two important steps as needed:
- submit to the Department any new cases they discover that were not previously submitted (or remove cases that were submitted that should not have been); and,
- review their own process of case identification, diagnostic coding and submission in light of these findings along with making any adjustments needed in order to provide complete and accurate data in accordance with Department requirements for the Severe Sepsis/Septic Shock clinical data as well as for SPARCS.
Please remember to complete the survey by May 29 https://www.surveymonkey.com/s/2YLCXYJ and, register for the upcoming Data Integrity Report Training for which you will be required to take action https://iproevents.webex.com/iproevents/onstage/g.php?d=660545492&t=a.
We appreciate your dedication to creating a robust, accurate, and complete data set for severe sepsis/septic shock in New York State.
Show [+] General Report Descriptions and Definitions
These reports are provided to aid hospitals with their internal data improvement processes with respect to case completeness and accuracy, and begin the process of data auditing by the Department of Health. We have been encouraging hospitals to use any and all methods for identification of severe sepsis and septic shock patients from their facilities. At the same time, the Department uses a variety of methods to authenticate the integrity of the data and to support hospitals in their data reporting efforts. To assist in efforts to ensure accurate case reporting (preventing over reporting of less severe cases or under reporting of severe sepsis or septic shock cases), we have created the Data Integrity Reports by comparing the severe sepsis and septic shock cases reported through the data submission portal to SPARCS.
Clinical sepsis data submitted to the state for Sepsis Quarter 1 (April 1, 2014-June 30, 2014) were pulled from the IPRO sepsis submission tool on January 5, 2015. These records were compared to SPARCS data for the same quarter, pulled on January 8, 2015, to determine if the matching record could be found in SPARCS. The data sets were matched using various iterations of combinations of unique personal identifier, date of birth, gender, admission date, discharge date, permanent facility identifier, patient control number and medical record number. These are variables that are requested in both the sepsis clinical data and SPARCS. Since these variables are vital to ensure proper matching of records, the values should be reported the same in both data systems.
Report #1 – SS/SS SPARCS
This report lists cases that were reported as severe sepsis or septic shock using the two ICD-9-CM codes (785.52, 995.92) in SPARCS, but were not found to be reported in the clinical data. This report can serve as a way to investigate cases to determine if they should have been reported in the clinical data. Response back on the first 30 cases is due to the Department. While this is first quarter data, and hospitals may have changed their case reporting processes over the more recent quarters, response is still required.
Report #2 – Modified Dombrovskiy SPARCS
This report lists the cases that were identified as severe sepsis/septic shock using a Modified Dombrovskiy definition (see below) in SPARCS, but the record was not found to be reported in the clinical data. This definition has been shown to have a defined probability of identifying some ‘true’ severe sepsis/septic shock cases in some hospitals. This report is provided as another way to check that all cases that should have been reported in the clinical data were reported. There is no feedback required for this report at this time but it is intended to be used by the hospitals for internal improvement purposes related to case finding.
Report #3 – Report in Clinical, not SPARCS
This report lists cases that were reported in the clinical sepsis data, but could not be found in SPARCS. This could be due to inconsistent reporting of the variables used to match the two datasets. If there is a case that should be reported to SPARCS, it is the facility’s responsibility to ensure that accurate information is reported to SPARCS.
Report #4 – Deaths
This report is provided as an edit check on the patient discharge status. Records submitted in the clinical sepsis data, in which a match was found in the SPARCS data, were evaluated with respect to mortality status. This report lists the records where the patient was reported as a death in the SPARCS data, but was reported as discharged alive in the clinical data.
Modified Dombrovskiy Definition
This is different from the standard Dombrovskiy Definition since it removes ICD-9-CM codes for severe sepsis or septic shock (785.52, 995.92).
Any ICD-9-CM diagnosis code of the following–
- 003.1 (salmonella septicemia),
- 020.2 (septicemic plague),
- 022.3 (anthrax septicemia),
- 036.2 (meningococcal septicemia),
- 036.3 (Waterhouse-Friderichsen syndrome),
- 038.0 (streptococcal septicemia)
- 038.1 (staphylococcal septicemia),
- 038.10 (staphylococcal septicemia, unspecified),
- 038.11 (Methicillin susceptible staphylococcal aureus septicemia),
- 038.12 (Methicillin resistant staphylococcal aureus septicemia),
- 038.19 (other staphylococcal septicemia)
- 038.2 (pneumococcal septicemia),
- 038.3 (septicemia due to anaerobes),
- 038.4 (septicemia due to other Gram-negative organisms),
- 038.40 (septicemia due to other Gram-negative organisms, unspecified),
- 038.41 (septicemia due hemophilus influenzae),
- 038.42 (Septicemia due to escherichia coli)
- 038.43 (Septicemia due to pseudomonas)
- 038.44 (Septicemia due to serratia)
- 038.49 (Other septicemia due to gram-negative organisms)
- 038.8 (other specified septicemias),
- 038.9 (unspecified septicemia),
- 054.5 (herpetic septicemia),
- 098.89 (gonococcemia),
- 112.5 (systemic candidiasis),
- 995.91 (systemic inflammatory response syndrome due to infectious process without organ dysfunction)
Any ICD-9-CM diagnosis code of –
- 286.6 (Defibrination syndrome)
- 286.9 (Other and unspecified coagulation defects)
- 287.5 (Thrombocytopenia, unspecified)
- 293.0 (Delirium due to conditions classified elsewhere)
- 287.4 (Secondary thrombocytopenia)
- 287.41 (Posttransfusion purpura)
- 287.49 (Other secondary thrombocytopenia)
- 348.1 (Anoxic brain damage)
- 348.3 (Encephalopathy, not elsewhere classified)
- 427.5 (Cardiac arrest)
- 458.0 (Hypotension, unspecified)
- 458.8 (Other specified hypotension)
- 458.9 (Hypotension, unspecified)
- 518.81 (Acute respiratory failure)
- 518.82 (Other pulmonary insufficiency, not elsewhere classified)
- 570 (Acute and subacute necrosis of liver)
- 572.2 (Hepatic encephalopathy)
- 573.4 (Hepatic infarction)
- 584 (Acute kidney failure)
- 584.5 (Acute kidney failure with lesion of tubular necrosis)
- 584.6 (Acute kidney failure with lesion of renal cortical necrosis)
- 584.7 (Acute kidney failure with lesion of renal medullary [papillary] necrosis)
- 584.8 (Acute kidney failure with other specified pathological lesion in kidney)
- 584.9 (Acute kidney failure, unspecified)
- 780.01 (Coma)
- 785.5 (Shock without mention of trauma)
- 785.50 (Shock, unspecified)
- 785.51 (Cardiogenic shock)
- 785.59 (Other shock without mention of trauma)
- 786.09 (Other respiratory abnormalities)
- 799.1 (Respiratory arrest)
- 796.3 (Nonspecific low blood pressure reading)
To help ensure that the data set, which will ultimately be used for public reporting of hospital performance, is both accurate and complete, the Department requests that each facility reviews the cases listed in the Data Integrity Reports. Each facility has a report that can be downloaded as an Excel file. The facility should review the first 30 cases in Report #1 and record the number corresponding to the reason for the Clinical Data and SPARCS mismatch in the column titled ‘Reason Number‘. See below for the reason number responses. If a facility has fewer than 30 cases in Report #1, then a reason should be recorded for every case. The Optional Reason Description field can be used if there is need to further describe the reason for mismatch. Facilities may additionally report back on more than the first 30 cases for Report #1, or for any cases in Report #2-4 if desired. The Excel file should then be uploaded back to the same website, with ‘response’ added to the end of the filename. This process will report the responses back to the Department. We thank you for your dedication in creating a robust, accurate, and complete data set for severe sepsis and septic shock in New York State.
Please describe the major reason this case was identified as severe sepsis or septic shock in the SPARCS data using the ICD-9-CM diagnosis codes, but was not reported in the clinical data (Report #1).
- Case was submitted to clinical data, error in patient unique personal identifier
- Case was submitted to clinical data, error in date of birth
- Case was submitted to clinical data, error in gender
- Case was submitted to clinical data, error in admission date
- Case was submitted to clinical data, error in discharge date
- Case was submitted to clinical data, error in patient control number
- Case was submitted to clinical data, error in medical record number
- Case should not have been coded as severe sepsis/septic shock in SPARCS
- Case should have been submitted in clinical data
- Other – please describe
Show [+] Training for Integrity Reports
Date and time: Monday, May 11, 2015 11:00 am
Eastern Daylight Time (New York, GMT-04:00)
Duration: 1 hour
Description: This event will provide critical information needed by hospitals to enable review and response to the NYSDOH Data Integrity Reports. These reports will require hospital action. The event will also provide instruction on upload, download, and data capture for required response reporting.
PowerPoint Presentation: Sepsis Data Integrity Reports (May 11, 2015)
Show [+] Report access
Hospitals will have access to the NYSDOH Data Integrity Report through DropZONE (NOT to be confused with dropbox).
While many hospitals already have a DropZone account, you will need access to the Sepsis folder to enable download of the Data Integrity Report(s) for your hospital.
The process to gain access is very straightforward and involves receiving an invitation email to the folder; acceptance of the folder via registering to DropZone (if you are not currently a member); and logging into your account. You will be directly brought to your hospital folder upon logging into your account.
A document detailing this process is available for download here.
Due to the nature of the data, the hospital primary user of the portal is the authorized account access user. Given privacy requirements, hospitals will only be permitted ONE back-up user.
Hospital primary users will receive a direct email on or about May 4, 2015 with instructions to gain access to the folder. After the primary user registers and has gained access, the primary user may send an email in reply with the name, title, contact information and email address of the single hospital back-up user.
The process to gain access to your reports will be reviewed in detail during the May 11 webinar therefore you may wish to register to attend if you have questions. At this time, you do not need to take action however please expect an email on or about May 4. You MUST respond to the email sent to gain access to your report; be sure to check your spam folder IF you are the primary user to ensure that you do not miss the opportunity to access your report.
Hide [-] Important Dates
Email access date: on or about May 4, 2015
Training date and time: Monday, May 11, 2015 11:00 am
Survey due deadline: May 29, 2015
Data integrity report responses deadline: June 30, 2015