Child pages
  • V3 State Data Submission Dashboard
Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

Version 1




Glossary

  • Average EMS Agencies per Submission Accepted: The average number of unique EMS agencies contained within the submissions accepted that contained at least one PCR. Agency uniqueness is determined by submitting state and EMS agency number
  • Average PCRs per Submission Accepted: The average number of PCRs contained within the submissions accepted that contained at least one PCR
  • Average Violations per PCR Accepted: The average number of non-fatal Schematron pattern violations per PCR that was accepted with at least one non-fatal violation Schematron pattern violation
  • EMS Agencies with > 0 PCRs Accepted: A count of EMS agencies that have had at least one patient care report accepted by the NEMSIS TAC web service
  • EMS Agency Demographic Files Accepted: A count of EMS agency demographic information files that have been submitted to and accepted by the NEMSIS TAC web service.
  • EMS Agency Demographic Files Rejected: A count of EMS agency demographic information files that have been submitted to and rejected by the NEMSIS TAC web service. For information on the causes of rejection see the Agency view of this Data Submission dashboard.
  • PCRs Accepted with Violations: A count of patient care reports accepted with at least one non-fatal violation of National Schematron patterns,  http://nemsis.org/media/nemsis_v3/release-3.4.0/Schematron/rules/DEMDataSet.sch.xml.
  • PCRs Accepted: A count of patient care reports submitted and accepted by the web service
  • PCRs Resubmitted: A count of patient care reports that have been resubmitted and the resubmission has been accepted since initial submission and acceptance.
  • Schema Version: The XML Schema Definition (XSD) version under which the submission failed validation
  • Schematron Violations per PCR Accepted: A count of non-fatal Schematron pattern violations for all patient care reports accepted
  • Submission Errors: A count of all errors generated by the web service that resulted in a submission rejection
  • Submission Lag: Submission lag is the difference in time between the recorded EMS Unit Back in Service time (NEMSIS national element eTimes.13) and the submission time to the NEMSIS web service expressed in fractions of an hour, after controlling for differences in time zones.
    • Submission Lag 25% (hours): The number of hours of submission lag below which 25%, the 25th percentile, of the accepted patient care reports exist.
    • Submission Lag 50% (hours): The number of hours of submission lag below which 50%, the 50th percentile, of the accepted patient care reports exist. The 50th percentile is equal to the median value of the distribution of submission lag times.
    • Submission Lag 75% (hours): The number of hours of submission lag below which 75%, the 75th percentile, of the accepted patient care reports exist.
  • Submission Rejection Message: The fatal error message generated by the NEMSIS TAC web service
  • Submission Type: The type of NEMSIS XSD schema, EMS or Demographic, under which the submission was validated and rejected.
  • Submissions Accepted: A count of all submissions accepted by the web service
  • Submissions Rejected: A count of all submissions rejected by the web service with an error. For details on submission errors see the Submission Detail view
  • Submissions: A count of all submissions received


State Data Submission Dashboard Description

The goal of the State Data Submission Dashboard is to provide EMS state data managers with timely actionable information on the status and quality of the national subset of data collected and submitted to the NEMSIS. To accomplish this goal the Data Submission Dashboard is broken into four views, one summary and three detailed topic areas. The three detail topic areas presented are Submission, Accepted Patient Care Reports (PCRs), and EMS Agencies.

Data Sets & Inclusion Criteria

The State Data Submission Dashboard is supported by four linked data sets: submission status, agency demographics, accepted patient care reports, Schematron rule violations, and submission rejections. The global inclusion criteria define the minimum characteristics a record must meet in order for it to be included in the data set that supports the dashboard. The inclusion criteria for all data sets in the Data Submission Dashboard are that any record in any data set must be associated with an identified state account for submission of NHTSA NEMSIS version 3.x data. For details on Schematron patterns, violation messages, and affected elements see the NEMSIS Schematron Business Rules.

Visualizations

The visualizations of the data submission dashboard have been separated into four views, a summary view and three topic areas: submission, accepted patient care reports, and EMS agencies.

Submission Summary View


The goal of the Submission Summary view is to provide the state data manager with the most important information from each topic area.


Submission Date Range Filtering

The Submission Summary dashboard view offers one filtering option, the submission date range filter. The date range filter enables the restriction of the data available in all views to a range of dates selected. The date that is being filtered is the date of submission to the NEMSIS TAC web service. The maximum range of the date filter is 14 days prior to the current day.


Changes made to the submission date range filter affect all views in the dashboard.

Submission Summary

The Submission Summary table provides key statistics on submissions to the NEMSIS TAC version 3.x

web service. Two types of submissions are supported by the web service; EMS agency demographic information and patient care report (PCR). Both types of submissions are included in the submission summary table. The following statistics are included in the summary table.

Please reference the Glossary section for definitions for the following:

  • Submissions
  • Submissions Accepted
  • Submissions Rejected
  • Submission Errors
  • Average PCRs per Submission Accepted
  • Average EMS Agencies per Submission Accepted

Submissions Accepted vs Rejected


The Submissions Accepted vs Rejected bar chart displays the trend over time of the share of total submissions that are accounted for by submissions accepted and submissions rejected.

  • X-axis: Calendar date the submission was received by the NEMSIS TAC web service
  • Y-axis: Count of submissions
    • Submissions Accepted
    • Submissions Rejected
    • Submissions Awaiting Processing

Patient Care Reports Accepted Summary

 The Patient Care Reports (PCR) Accepted summary table provides key statistics on all of the PCRs submitted to and accepted by the NEMSIS TAC version 3.x web service. Please reference the Glossary section for definitions for the following:

  • PCRs Accepted
  • PCRs Accepted with Violations
  • PCRs Resubmitted
  • Schematron Violations per PCR Accepted
  • Average Violations per PCR Accepted
  • Average PCRs per Submission Accepted
  • Submission Lag
    • Submission Lag 25% (hours)
    • Submission Lag 50% (hours)
    • Submission Lag 75% (hours)

PCRs Accepted With & Without Schematron Violations

The PCRs Accepted With & Without Schematron Violations bar chart displays the trend over time of the share of accepted patient care reports that had no Schematron pattern violations, http://nemsis.org/media/nemsis_v3/release-3.4.0/Schematron/rules/DEMDataSet.sch.xml, and those that had a minimum of one violation.

  • X-axis: Calendar date the submission was received by the NEMSIS TAC web service
  • Y-axis: Count of submissions
  • PCRs Accepted without any Schematron pattern violations
  • PCRs Accepted with non-fatal Schematron pattern violations

Agencies Summary

The Agencies summary table provides key statistics on the EMS agency demographics information submitted to and accepted by the NEMSIS TAC version 3.x web service as well as PCR activity from those agencies.

Please reference the Glossary section for definitions for the following:

  • EMS Agencies with > 0 PCRs Accepted
  • EMS Agency Demographic Files Accepted
  • EMS Agency Demographic Files Rejected 

Active EMS Agencies per Day

The Active EMS Agencies per Day bar chart displays the trend over time of the number of unique EMS agencies that have had at least one patient care report submitted to and accepted by the NEMSIS TAC web service. Uniqueness of the EMS agency is determined using the national element eResponse.01, EMS Agency Number.

  • X-axis: Calendar date the a submission from the EMS agency was received by the NEMSIS TAC web service
  • Y-axis: Count of unique EMS agencies for the day.

 

Submission Detail View

The goal of the Submission Detail view is to provide additional actionable information to the data manager beyond that contained in the summary view. The additional information provided by the submission detail view includes submissions by weekday and hour as well as details on errors that resulted in a submission being rejected the NEMSIS TAC web service.

Relative Date Range Filtering

The Submission Summary dashboard view offers one filtering option, the relative date range filter. The date range filter enables the restriction of the data available in all views to a range of dates relative to the present day. The date that is being filtered is the date of submission to the NEMSIS TAC web service. The default value for the relative date range filter is 30 days prior to the current day.

Changes made to the relative date range filter affect all views in the dashboard.

Submission Summary

The Submission Summary table provides key statistics on submissions to the NEMSIS TAC version 3.x web service. Two types of submissions are supported by the web service; EMS agency demographic information and patient care report (PCR). Both types of submissions are included in the submission summary table. The following statistics are included in the summary table.

Please reference the Glossary section for definitions for the following:

  • Submissions
  • Submissions Accepted
  • Submissions Rejected
  • Submission Errors
  • Average PCRs per Submission Accepted
  • Average EMS Agencies per Submission Accepted

Submissions Accepted vs Rejected

The Submissions Accepted vs Rejected bar chart displays the trend over time of the share of total submissions that are accounted for by submissions accepted and submissions rejected.

  • X-axis: Calendar date the submission was received by the NEMSIS TAC web service
  • Y-axis: Count of submissions
  • Submissions Accepted
  • Submissions Rejected

Submissions by Weekday & Hour

The Submissions by Weekday & Hour heat map displays the distribution of the number of submissions across the days of week and four 6-hour blocks of time from midnight to midnight. The heat map includes both accepted and rejected submissions for both patient care records and EMS agency demographic information.

Submission Rejections

The submission rejections table lists error messages generated by the NEMSIS TAC web service that resulted in the rejection of a submission along with a count of the number of occurrences of each message.

  • Submission Rejection Message: The fatal error message generated by the NEMSIS TAC web service.
  • Schema Version: The XML Schema Definition (XSD) version under which the submission failed validation.
  • Submission Type: The type of NEMSIS XSD schema, EMS or Demographic, under which the submission was validated and rejected.

Schematron Fatal Violations

The Schematron Fatal Violations table lists fatal violation messages generated by one of the National Schematron patterns that caused a submission to be rejected.

  • Schematron Error Messages: The fatal error message generated by Schematron prior to rejection of the submission

Accepted PCR Detail View

The goal of the Accepted PCR Detail view is to provide the state data manager with additional detail on the sources of non-fatal Schematron pattern violations for patient care records that have been both submitted to and accepted by the NEMSIS TAC.

Filters

The PCRs Accepted dashboard view offers four filtering options: Software Package, Software Version, EMS Agency Number, and Submission Date Range. Only changes to the data range filter affect the data available in all four views of the dashboard. The software package, software version, and EMS agency filters only affect the data available on the PCRs Accepted dashboard view. All of the filters act upon the data simultaneously and can be selected in any order, e.g. selecting a single software package and a single software version will restrict the available patient care reports to those created with the specific software package and version selected.

Software Package Filter

The software package filter allows the data manager to restrict the patient care reports available in the current view to those generated by the selected field-level software product in use by EMS agencies within the data manager’s state. The date range filter enables the restriction of the data available in all views to a range of dates relative to the present day. The date that is being filtered is the date of submission to the NEMSIS TAC web service. The default value for the relative date range filter is 30 days prior to the current day. Changes made to the relative date range filter affect all views in the dashboard. Changes made to the software package filter only affect the PCRs Accepted dashboard view.

Software Version Filter

The software package filter allows the data manager to restrict the patient care reports available in the current view to those generated by a specific version of the currently selected field-level software products in use by EMS agencies within the data manager’s state. Changes made to the software version filter only affect the PCRs Accepted dashboard view.

EMS Agency Number

The EMS agency number filter allows the data manager to restrict the patient care reports available in the current view to those generated by a single EMS agency operating within the data manager’s state. Changes made to the software version filter only affect the PCRs Accepted dashboard view.


Date Range Filter

The date range filter enables the restriction of the data available in all views to a range of dates relative to the present day. The date that is being filtered is the date of submission to the NEMSIS TAC web service. The default value for the relative date range filter is 30 days prior to the current day. Changes made to the relative date range filter affect all views in the dashboard.

PCRs Accepted Summary

The Patient Care Reports (PCR) Accepted summary table provides key statistics on all of the PCRs submitted to and accepted by the NEMSIS TAC version 3.x web service.

Please reference the Glossary section for definitions for the following:

  • PCRs Accepted
  • PCRs Accepted with Violations
  • PCRs Resubmitted
  • Schematron Violations per PCR Accepted
  • Average Violations per PCR Accepted
  • Average PCRs per Submission Accepted
  • Submission Lag
  • Submission Lag 25% (hours)
  • Submission Lag 50% (hours)
  • Submission Lag 75% (hours)

PCRs Accepted with and without Schematron Violations

The PCRs Accepted with and without Schematron Violations bar chart displays the trend over time of the share of accepted patient care reports that had no Schematron pattern violations, http://nemsis.org/media/nemsis_v3/release-3.4.0/Schematron/rules/DEMDataSet.sch.xml, and those that had a minimum of one violation.

  • X-axis: Calendar date the submission was received by the NEMSIS TAC web service
  • Y-axis: Count of submissions
  • PCRs Accepted without any Schematron pattern violations
  • PCRs Accepted with non-fatal Schematron pattern violations

Average Violations per PCR by Unit Notified Date & Time

The Average Violations per PCR by Unit Notified Date & Time heat map displays the distribution of the average number of non-fatal Schematron violations across the days of the week and four 6-hour blocks of time from midnight to midnight. The time and date element used to segment the patient care records is the NEMSIS national element eTimes.02 – Dispatch Notified Date/Time.

Average Violations per PCR by Incident Zip Code

The Average Violations per PCR by Incident Zip Code geographic map displays the geographic

distribution of average Schematron violations by incident zip code as reported in NEMSIS element

eScene.19 – Incident Zip Code.








Average Violations per PCR by Element

The Average Violations per PCR by Element bar chart displays the average Schematron pattern violations

by NEMSIS national element.

Average Violations per PCR by EMS Agency

The Average Violations per PCR by Element bar chart displays the average Schematron pattern violations by EMS Agency number as reported in NEMSIS national element eResponse.01 – EMS Agency Number.

Average Violations per PCR by Schematron Pattern

The Average Violations per PCR by Schematron Pattern bar chart displays the average Schematron pattern violations by the Schematron Pattern.

Average Violations per PCR by Software Package & Version

The Average Violations per PCR by Software Package & Version bar chart displays the average Schematron pattern violations by each unique combination of field software package and version number.

Average Violations per PCR by Schematron Violation Warning Message

The Average Violations per PCR by Schematron Violation Warning Message bar chart displays the average Schematron pattern violations by specific violation message generated by Schematron in response to the violation of a pattern contained in the Schematron Business Rules for patient care reports.

EMS Agency Detail View

The goal of the Ems Agency Detail view is to provide the state data manager with additional detail on the activity of EMS agencies within their state that have had their demographic information submitted to and accepted by the NEMSIS TAC.

Filters

The EMS Agency detail dashboard view offers one filtering option, the relative date range filter. The date range filter enables the restriction of the data available in all views to a range of dates relative to the present day. The date that is being filtered is the date of submission to the NEMSIS TAC web service. The default value for the relative date range filter is 30 days prior to the current day. Changes made to the relative date range filter affect all views in the dashboard.

Agencies Summary

The Agencies summary table provides key statistics on the EMS agency demographics information submitted to and accepted by the NEMSIS TAC version 3.x web service as well as PCR activity from those agencies.

Please reference the Glossary section for definitions for the following:

  • EMS Agencies with > 0 PCRs Accepted
  • EMS Agency Demographic Files Accepted
  • EMS Agency Demographic Files Rejected

Active EMS Agencies per Day

The Active EMS Agencies per Day bar chart displays the trend over time of the number of unique EMS agencies that have had at least one patient care report submitted to and accepted by the NEMSIS TAC web service. Uniqueness of the EMS agency is determined using the national element eResponse.01, EMS Agency Number.

  • X-axis: Calendar date the a submission from the EMS agency was received by the NEMSIS TAC web service
  • Y-axis: Count of unique EMS agencies for the day.

Accepted PCRs by EMS Agency

The Accepted PCRs by EMS Agency bar chart displays the number of patient care reports accepted by the NEMSIS web service for each EMS agency collecting and submitting data within the state supervised by the data manager.

EMS Agencies with Demographic Information Accepted

The EMS Agencies with Demographic Information Accepted table lists the number of times demographic information has been accepted for an EMS agency. An accepted number greater than 1 for a specific agency indicates that demographic information was resubmitted and accepted multiple times.

EMS Agencies Missing a Demographic File Submitting EMS Records

This table lists agencies by EMS Agency Number where EMS records have been received, but no demographic data.

EMS Agency Demographic Submissions by Home State

The EMS Agency Demographic Submissions by Home State map displays the number of accepted EMS agency demographic information submissions by the reported agency home state as defined by dAgency.04.

Email Summary View

The goal of the Email Summary is to provide an overview of submissions in a state over the previous 2 weeks. This is emailed to each data manager every Tuesday.


Failed Submissions

Failed Submissions is the percentage of submissions that failed from the total number of submissions made in the 2 week date range.

  • A green box indicates less than 1% of submissions failed.
  • A yellow box indicates 1% to 2.9% of submissions failed.
  • A red box indicates 3% or more of submissions failed.


Active Agencies

Active Agencies is the percentage of EMS agencies with at least one patient care record submitted and accepted in the 2 week date range from the total number of EMS agencies the state expects to submit to NEMSIS. The number of EMS agencies the state expects to submit to NEMSIS is equivalent to the number of Agencies Expected.

  • A green box indicates 80% to 100% of the submissions were accepted from an active agency.
  • A blue box indicates 79.9% to 70% of the submissions were accepted from an active agency.
  • A red box indicated less than 70% of the submissions were accepted from an active agency.

PCR Warnings

PCR Warnings is the percentage of PCRs that were accepted with at least one Schematron warning from the total number of PCRs accepted in the 2 week date range.

  • A green box indicates less than 10% of submissions had PCR warnings.
  • A yellow box indicates 10% to 19% of submissions had PCR warnings.
  • A red box indicates 20% or more of submissions had PCR warnings.


Patient Care Reports (PRC)

Patient Care Reports is a distinct count of PCRs accepted by day of submission in the 2 week date range.

Average

Average is the average count of PCRs accepted per day for the time period.

Total Patient Care Reports Accepted, Year To Date

Total Patient Care Reports Accepted, Year to Date is the total number of patient care reports submitted and accepted since the beginning of the year.

Tableau Toolbar

All Tableau dashboards share the same toolbar at the bottom of the view. Note that while most dashboards will have the same selections, some items may differ based on user permissions.

Undo, Redo, Revert, Refresh and Pause

These selections are found on the left side of the Tableau toolbar and can be used to help navigate the dashboard.

Undo will remove the last selection made, if you have used undo to remove a selection, you can then use redo to return to that selection. Revert returns the dashboard to its original view. Refresh will reload the data on the dashboard subject to any selections made. Pause will stop the dashboard from refreshing as you make selections.

As an example, if you want to make a set of complete selections in a dashboard’s filters, you could use these buttons to speed up the process. Normally, every time a change is made, the dashboard will refresh. If you select “Pause” however, the dashboard will remain the same no matter how many selections you make. Once you have made all your selections, you can select “Refresh” to reload the dashboard based on those selections.

Subscribe, Custom Views, Edit, Share, and Download

These selections are found on the right side of the Tableau toolbar and can be used to interact with the dashboard in external ways.

The Subscribe button allows users to subscribe to a daily or weekly email that will show a static image of the dashboard as well as a link to the view.

You can select either a particular view (tab) or all the views (tabs) available in the dashboard. Under “Email Subscriptions,” you can choose the frequency of emails. In “Subject Line,” you can assign the subject for the emails. As a default, the subscription will be assigned to the email address associated with your NEMSIS account.

Custom Views allows users to save any particular set of filters or selections for quick access later. A user can create their view and then name it and save it either for their own personal use or use by anyone with access to this dashboard. Previously saved views will appear in the custom views tab.

Edit will open the dashboard in the web editor for Tableau. Note that this option is not available on all dashboards and will require some knowledge of how to use Tableau to build and edit dashboards.

Share will provide a couple of options for sharing the dashboard with others, specifically an embed code and a regular HTML link. While you can use the link to share the dashboard with others, please keep in mind that many of the NEMSIS dashboards will require a username and password. Only those with credentials will be able to access them.

The last option is Download. Clicking on the download button opens up several options to download either the workbook, the data within it, or a static image of the view.

Selecting any one of these file types will produce a download of the requested file. Remember that not all options will be available for all dashboards and views.

Contact Info

Any questions, comments, concerns, or suggestions regarding this or other reports made available by the NEMSIS TAC, please contact us or leave a comment below!

Contact information is also available on the NEMSIS website.

Kevin White, BS
University of Utah School of Medicine
NEMSIS Technical Assistance Center
Phone: (801) 213-3408
Fax: (801) 581-8686
Email: kevin.white@hsc.utah.edu
Laurel Baeder, BA, MStat
University of Utah School of Medicine
NEMSIS Technical Assistance Center
Phone: (801) 587-5337
Fax: (801) 581-8686
Email: laurel.baeder@hsc.utah.edu




  • No labels