Introduction
This document has been made available by AgSafe BC and AuditSoft™. It is provided to AgSafe BC internal and external auditors as a guide for using AuditSoft™ to complete a COR audit of a registered AgSafe BC organization.
This document should be referenced in conjunction with the AgSafe BC Auditor training handbook.
This training program is the result of a 2023 modernization initiative that replaced the outdated PDF audit with AuditSoft™, the industry leading electronic audit software solution.
As part of the modernization project some audit questions and relationships between questions were changed and/or updated.
IMPORTANT: The AuditSoft™ implementation covered in this document includes these approved changes and the audit covered in this document is not identical to the obsolete PDF audit that was used in prior years. |
Getting Started
First, Download AuditSoft and create your account by following the instrustions in this article: Getting Started with AuditSoft
Get a License
A license is required for every audit that is started.
Licenses must be requested from AgSafe BC and will be approved by AgSafe BC if your account is in good standing.
Each license is issued for the specific name of the company that will be audited.
The license is valid for one audit and for 9 months (270 days) after it has been approved. This means that you must complete your audit of the company within 9 months from the day that you request a license.
To obtain a license:
1. Click on Get new license.
2. Select the AgSafe BC COR audit from the list of available audits.
Note: Be sure NOT to select the AgSafe BC Small Employer Certificate of Recognition (SECOR) audit if you are doing a COR audit. |
3. Enter the Legal name of the company to be audited.
Training License: If you are not ready to start an audit you can obtain an evaluation license. In the Legal name of company to be audited enter: “Evaluation” |
4. Click Submit Request to have your license request submitted to AgSafe BC
5. You will be returned to the AuditSoft™ Home page and the requested license with the status, License pending approval, will be listed on the left side of the page.
6. To check if the license has been approved click the refresh button. Once approved the License pending approval status will be removed and you are ready to start your audit.
Note: It can take up to 2 business days to have your license request approved. When approved you will receive an email notification.
Open your License
Once the AuditSoft™ License has been approved you can:
1. Click on the license name under the Start a new audit column.
Start your Audit
1. This will open a new audit and the audit Instructions page will be displayed. Read the instructions.
2. Before you proceed click on the training link and complete the AuditSoft™ Application Overview online training.
Online training is mandatory: Please do not proceed unless you have completed the 45-60 min online training course. The rest of this guide assumes you have completed the training and that you are familiar with the AuditSoft™ workflow and terminology covered in the training.
Note: Remember to download a copy of your certificate of completion. You will need it to submit your audit. |
3. If you are completing a Team Audit, select the article and it will provide steps on instructions.
Audit Workflow
Now that you have completed the AuditSoft™ Application Overview Online training and you have started a new audit we can proceed.
1. The workflow for completing an audit is to start at the instructions in the left navigation menu and to then complete the items systematically from the top to bottom, completing each section in the left navigation menu before moving to the next.
Audit Information
Company Details
This section lists the details of the company or organization that is being audited. Companies often merge or are acquired and AuditSoft™ supports changes in business structure:
You can add multiple WorkSafeBC numbers.
And multiple Classification Unit codes can be assigned to each WorkSafeBC number.
Audit Details
An audit is a snapshot that represents the state of a company’s occupational health and safety program at a specific point in time. To ensure that the audit is completed in a timely matter, guidance is provided to the auditors on the amount of time that the audit should take:
The amount of time from the first day on site until the last day on site (the evidence gathering phase of the audit) should not exceed 45 days.
The amount of time after the last day on site until the audit is submitted (the report writing part of the audit) should not exceed 45 days.
To remind the auditor of this guidance:
There is a reminder clock in the upper left corner of the software.
The available time on the clock is determined by the dates in the Audit Details section.
Pre-Audit Meeting
Enter all attendees of the Meeting.
Define the Date of the Meeting.
Check off all boxes.
The time frames of the clock in AuditSoft™ are there to guide the auditor with the intent of closing the audit snapshot in a recommended time frame. AgSafe BC is the final authority on the amount of time that can be taken to complete your audit and AgSafe BC may allow you to exceed the suggested time frames.
Important: Exceeding the recommended allotted time does NOT affect your ability to submit your audit. |
After the Audit Information section has been completed (indicated by the green check mark next to each subsection) it is time to move to the next section of the audit.
Scope
Select Content
There are 9 elements in the AgSafe BC COR audit and only one of these elements, element 9, can be excluded from the audit.
If the company does not hire contractors other than owner operators, then Element 9 is not applicable and should be unselected on the Select Audits Content page. |
Site Sampling
An important part of audit planning is to determine which sites to visit, how many interviews to do and the number of observation tours to complete.
The worksites included in the audit must be representative of the organization’s overall operations. To determine the number of worksites to visit, the AgSafe BC worksite visit guidelines have been incorporated and AuditSoft™ automatically calculates the number of sites to include based on the active sites entered. The main office/shop must be included in the scope of the audit.
The head office / main office / shop must be included in the scope of the audit. |
When updating this Site Sampling Summary page:
1. Select Add site to add every active site and the head office for the company.
2. For each site, enter the number of employees in each role that work at the site.
3. Now enter the number of employees that fall within the Joint Health and Safety Committee (JHSC) and New/Young Worker group at each site. These groups will be asked additional questions during the audit interviews. For example, of the 14 employees at the Vancouver site, there is 1 employee that is part of the JHSC and 5 that are New Workers.
It is important to enter all the sites and all the employees at each site. If you have many sites (typically over 30) you can select Adjust these numbers manually to add many sites at once (see item 4) |
5. Based on the number of employees entered, a recommended minimum number of interviews is calculated. This recommended number of interviews is calculated based on AgSafe BC interview sampling guidelines.
Next determine which sites with be included in the audit. To be included means that you will perform at least one evidence gathering activity at the site. There are 3 evidence gathering methods:
D - Documentation review.
I - conducting employee Interviews.
O - completing an Observation tour.
6. For other (“branch”) sites you may or may not include a documentation review (more about this in the documentation review section), interviews and/or observations based on the setup of the audit and whether you will physically or virtually visit the site.
7. Always include the head office in the audit. In most cases you will want to complete all 3 evidence gathering steps (DIO) at the head office.
Interview Planning
Interview planning ensures that you select a representative sample of employees to interview. If the auditor determines that additional interviews are required based on organization size and diversity of work, the planned number of interviews can be adjusted:
The Recommended interviews are automatically calculated based on the fact that a fraction of a person cannot be interviewed. The result is that the Recommended interviews will often exceed the Minimum required interviews.
The distribution of the interviews across the included sites is presented in the interview plan.
Selecting the Use Custom Interview Plan option will allow the auditor to change this distribution of interviews manually.
After the Scope section has been completed, with a green check mark next to each subsection, it is time to move to the next section of the audit.
Gather Evidence
When gathering evidence, it is standard audit practice to visit one site at a time. At each visited site you may decide to complete any, or all, of the following evidence gathering steps:
Review documentation (D) to ensure that policies and procedures are in place,
Interview (I) employees to verify that they are aware of the policies and procedures, and
Complete an observation (O) tour to confirm that policies and procedures are being adhered to.
With the use of technology and specifically online document repositories (Dropbox, SharePoint, etc.) and video conferencing tools (Zoom, Teams, etc.), some of the documentation review and interview tasks can often be completed remotely or from a single location.
Review Documentation
When you start an audit, it is best practice to start with a documentation review at the Head office. Depending on the documentation available at the Head office you may not have to review documentation at other (“branch”) sites. During the documentation review there are generally two types of documents that are encountered:
Directive Documents – These include policies and mission statements that apply to the entire company. Because they are company-wide documents, they only need to be reviewed at the head office. They are the same at every other site and can therefore be omitted and do not have to be reviewed again when visiting other sites.
Operational Documents - These on the other hand, are site-specific and include pre-job hazard assessments, inspections, emergency response plans and site-specific job descriptions that are specific to each site. If these documents cannot be accessed and reviewed at the head office, they should be reviewed at every other site included in the audit.
To start the documentation review at the head office:
In the Gather Evidence section of the left navigation menu select Review Documentation and then select Add/Edit next to the head office site name.
All documentation review questions should be answered at the Head office.
The only questions that do not need to be answered are those optional questions that may not be applicable and that can be marked as Question is not applicable to this audit.
Questions that are marked as “Question is not applicable to this audit” will not be scored and will not be included in the overall audit pass/fail calculations. |
The documentation review requires the auditor to determine the % Compliant based on the following available options:
1. Yes (100%), Partial (50%), No (0%)
2. Yes (100%) or No (0%)
3. Percentage Compliant. For example:
If the auditor is looking at 5 inspection reports, and find that 3 of the reports have a corrective action plan then 3/5 = 60%
Reviewing documents at Other Site(s)
At the start of the Review Documentation section the differences between directive and operational documents were discussed. If all the operational documents required for the audit were not available at the head office for review, it may be necessary to review only those operational documents that were not available as part of a head office documentation review at other site(s).
4. Start the documentation review at the next site.
5. At the site, questions related to directive documents, that have already been reviewed at the head office, can be ignored and can either be:
marked as Not applicable to site, or
can be left blank.
6. Questions related to operational documents that are specific to the site, and that could not be reviewed at the head office, like site specific emergency response plans should be answered.
When you are completed your Documentation, you can select the Results column to view total Scoring and Comments.
The decision as to whether operational documentation should be reviewed only at the head office or also at additional sites will be determined by the availability of documents and is ultimately a decision that each auditor must make on a case-by-case basis. |
Conduct Interviews
After confirming the existence of the required documentation, the next step is to verify how well the health and safety system is communicated to employees. This is accomplished by interviews to determine if employees were included in the development of the program and to gauge their understanding of the OHSMS procedures and policies.
A representative sample of employees will be interviewed to verify specific audit questions. The auditor will determine whether the interviewee provided a positive or negative response. If an interviewee is unwilling to provide a response to an interview question it can be marked as no comment, which is treated as a negative response.
It is an industry best practice to interview employees one-on-one in a private setting where they can speak openly. To start an interview:
Select the role of the person that you are interviewing at the site where they work.
Then select Start.
The Interview page will only list questions that are applicable to the role of the interviewee that was selected.
3. At the top of the page, based on the role, there may be an employee attributes that can be selected if the interviewee is a member of the Joint Health and Safety Committee and/or a New/Young Worker. These attributes are associated with additional questions that are added to the questions list if it is checked.
4. On the right of the page, there are 4 responses Thumbs up (positive response), Thumbs down (negative response), No comment, Question is not applicable to site.
Once all interviews are completed, note 1 below as all sections should be filled out and marked in green.
Interview responses are stored in the AuditSoft™ audit file (.asa), but to ensure auditor interviewee confidentiality individual interview responses are not reported in the PDF audit report. Responses are aggregated and converted into a % which is included in the report and used to score the audit.
Important: Care should always be taken to ensure that specific employee responses cannot be deduced from written findings in the Audit Results section of the audit. |
Record Observations
The final evidence gathering step is to complete a tour of the site(s) that were visited and to record observations. The purpose of conducting observations is to verify the information gathered during the documentation review and the interviews, and to get a sense of the overall level of compliance with the standards and company policies and procedures.
In AuditSoft™ navigate to Record Observations within the Gather Evidence section on the left side in the navigation menu and enter your detailed observation notes for each site toured.
Averaging the Observation % Compliant over multiple sites is calculated based on a Mathematical average. For example: if based on your observation you assign a “Yes” or 100% Compliant at the head office and a “No” or 0% Compliant at another site the Result that will be used for scoring will be (100% +0%) / 2 = 50% |
The evidence gathering steps represent the bulk of work in any audit and after completion the Gather Evidence section in the navigation menu will be marked with a green check mark next to each subsection. It is now time to move to the next section of the audit.
Audit Results
The Audit Result section is where we draft the final audit responses that will appear in the report. Any notes that we recorded during the Evidence Gathering steps can be accessed and referenced to formulate the final audit response.
The information presented in this section must be detailed enough for the organization to address gaps identified in their OHSMS.
Audit Results contains 9 elements, and each element of the audit has several questions. When answering each question, it is important to keep the content separate and to not duplicate content. In general, there are three (3) text areas per question for recording:
Findings and notes are required for all questions.
Strengths are optional.
Recommendation/Opportunities for improvement: A Recommendation is required if you do not achieve all the available points for a question, else you can optionally define an Opportunity for Improvement.
When composing the final audit responses for a question click on Show Comments (4) to view and/or copy your Evidence Gathering notes associated with the question. Remember that you are now compiling the final response and you should rewrite your notes as full sentences for the final report. |
Scoring
Every audit question is verified during the Evidence Gathering process by appropriate documentation, interview and/or observations and by then assigning a % Compliant for each verification method used.
The % Compliant assigned to each question is automatically converted into question scores through one of the AgSafe BC automatic scoring rules. If a question has multiple evidence gathering requirements the scoring rules are applied to each separately:
Yes or No Scoring - Must be 100% compliant to get all the points. o
Yes/Partial/No Scoring - Must be 100% compliant, 50% compliant or 0%
Evidence Sampling – In this instance the auditor looks at a sample of data and then records the number of items in the sample that met the audit requirements. This is then used to calculate the % Compliant. For example:
If the auditor is looking at 12 inspection reports, and find that 11 of the reports have a corrective action plan then 11/12 = 92% are compliant, or
If the auditor is looking for 3 requirements within a document and only 2 are present, then the document is 2/3 = 67% compliant. Two questions have unique sampling requirements in the documentation review:
After answering every question in the Audit Results section, it will be marked with a green check mark next to each element and sub element. It is now time to move to the next section of the audit.
Summary Information
The final section of the audit to complete is the (1) Summary information section. This section is an accumulation of supporting documents and attachments that must be provided as part of the audit submission. Each sub-section may include:
2. Guidelines outlining what is expected as a response.
3. An area for providing a written response and/or
4. The ability to attach a document.
After completing this section your audit has been completed and there should be a green check mark next to each element on the left menu of AuditSoft™. It is now time to move to the final section to submit your audit for quality assurance review.
Review and Submit
You are now ready to review your audit before submitting it:
1. The Save PDF report button in the toolbar will create a draft PDF for you to review.
You do not have to complete the entire audit to review your PDF draft. You can create a draft at any time even if your audit is only 5% or 10% complete. Drafts are not submitted to AgSafe BC. |
Draft PDF reports will be opened in the default PDF viewer on your computer. Not all free PDF viewers are updated regularly to comply with the latest released PDF format changes. It is highly recommended that you install and use the latest version of the Adobe Reader (see https://get.adobe.com/reader) to view the generated draft audit report. |
When you have reviewed the draft and you are ready to submit it to AgSafe BC:
2. Select Submit from the bottom left in the navigation menu.
3. Confirm that there are not any incomplete sections in your audit. If there are, click on the link(s) to add additional content and then return to this section.
4. Click Send to submit your audit to AGSafe BC for quality assurance (QA).
Questions and Support
Content Questions
For answers to questions related to the content of the audit like:
what exactly is expected as a response or
where you can get more detail on how to answer a question or
can this question be reworded, etc.
Please reach out to AgSafe BC for clarification they can be reached at:
Email: [email protected]
Phone: 1 (877) 533 1789
AuditSoft™ Questions
AuditSoft™ is a software company that implemented the questions set and guidelines as they were provided by AgSafe BC . AuditSoft™ cannot change questions and/or wording independent of approval by AgSafe BC.
If you have a question about how the AuditSoft™ software application works, there is an extensive online manual including many frequently asked questions (FAQ) responses that can be accessed at:
Online FAQ articles: https://AuditSoft.co/support/
Or if you require software support, please contact AuditSoft™ at:
Email: [email protected]
Phone: 1 (888) 514 3534