Canada Revenue Agency Employee Survey

Detailed information for 2005

Status:

Inactive

Frequency:

Occasional

Record number:

5087

The primary objective of the survey is to obtain the views of all Canada Revenue Agency (CRA) employees about their workplace. The information will allow managers and employees to initiate concrete actions in the agency, and compare their results with the rest of the Public Service.

Data release - June 23, 2006 (No public use microdata file was produced by Statistics Canada and data will not be made available through the Data Liberation Initiative (DLI).)

Description

The first Public Service Employee Survey (PSES, record number 4438) was conducted in 1999. Almost 55% of the workforce participated, providing important information about how employees viewed their work and workplace. Departments and agencies launched a number of initiatives to address the workplace issues identified by Public Service employees in the 1999 PSES.

As a follow-up to the 1999 PSES, the Privy Council Office asked the Treasury Board Secretariat to conduct a second voluntary survey of all Federal Public Service employees. As with the 1999 PSES, Statistics Canada was asked to participate in the survey development and to collect and process the data.

It should be noted that the Canada Customs and Revenue Agency (CCRA) participated in the 1999 Public Service Employee Survey but for the 2002 follow-up, CCRA had become a separate agency and as such was no longer part of the target population for the survey. However, the CCRA decided to do its own employee survey using the same questionnaire as the PSES. Statistics Canada was asked to implement the survey, including the development, collection and processing of the data for the CCRA.

The Canada Customs and Revenue Agency (CCRA) became the Canada Revenue Agency (CRA). Therefore, as of the 2005 reference period, this survey was renamed the Canada Revenue Agency Employee Survey.

The 2005 Canada Revenue Agency Employee Survey was designed as a follow-up of the 2002 survey to enable the agency to identify areas where it is doing well and point to other areas where improvement is still needed. In addition to making it possible for new employees to provide their perspectives on the workplace, the survey ensures a measurement capacity between the 1999 and 2002 questionnaires. There was no change between the 2002 and 2005 survey questionnaires.

The survey solicited views of CRA employees on their work environment and overall job satisfaction. Employees expressed their opinions on their work unit, their communication with their supervisor, skills and career aspirations, client services and labour management relations. General information such as age, gender, years of service and province of work were collected and questions were asked on specific themes such as staffing fairness, official languages, health and safety, harassment and discrimination, and retention issues.

A fundamental objective of the 2005 Canada Revenue Agency Employee Survey was to seek employee opinion on a variety of issues related to organizational effectiveness, workplace well-being and service delivery. It was also essential to ensure that progress made since the first survey could be measured.

Statistical activity

The survey is currently administered as part of the Public Service Employee Survey Program (PSES). This program includes the main Public Service Employee Survey (record number 4438) and a number of other department or agency-specific employee surveys. The target population of the main Public Service Employee Survey is employees of the federal Public Service employed under Schedule I, Part I of the Public Service Staff Relations Act (PSSRA 1-1), while the other surveys are conducted for departments or agencies that are covered in Schedule I, Part II. The primary objective of the program is to obtain the views of employees of the federal Public Service about their workplaces. The information will allow managers and employees to initiate concrete actions in their own department or agency, and where warranted, across the Public Service.

Subjects

  • Government
  • Labour

Data sources and methodology

Target population

The target population for the survey was all employees of the Canada Revenue Agency, with the following exceptions:
1. Students;
2. Governor-in-council appointments; and
3. Minister's exempt staff.

Instrument design

The PSES questionnaire content was developed by an Interdepartmental Committee comprising representatives from small, medium and large departments/agencies, as well as representation from the Small Agencies Group, Statistics Canada, central agencies, bargaining agents and an external advisor. The questions for this survey were chosen based on their usefulness to employees, managers and bargaining agents in helping to identify problems and provide concrete solutions to improve the work environment. The 2002 and 2005 Public Service Employee Survey were follow-up surveys to the 1999 PSES. In order to ensure comparability between the 1999 and 2002 surveys, key questions from the 1999 PSES remained identical in the 2002 PSES, while minor changes were made to some other questions. New questions were added in place of certain questions from the 1999 PSES in order to explore new themes and provide additional information on issues identified in the first survey. There was no change to the questionnaire between 2002 and 2005.

In 2002, focus groups were held across the country and included employees at various groups and levels as well as English and French focus groups. Comments from the focus groups were integrated into the questionnaire and a final layout was decided. Participating departments and agencies were also invited to provide comments on the draft questionnaire. All Survey Champions (departments and agencies) were invited to briefings on the questionnaire and project plan. The Minister responsible for the Treasury Board of Canada Secretariat approved the delivery of the second survey.

The final questionnaire was also provided to Canada Revenue Agency (CRA) to assist in CRA's efforts to deliver a comparable instrument.

Sampling

This survey is a census with a cross-sectional design.

Data are collected for all units of the target population, therefore no sampling is done.

Data sources

Data collection for this reference period: 2005-11-02 to 2006-01-12

Responding to this survey is voluntary.

Data are collected directly from survey respondents.

The Canada Revenue Agency Employee Survey was a census. Each member of the target audience received a paper questionnaire to complete. The survey was anonymous; that is, the respondent's name or other identification was not required on the questionnaire.

The CRA was responsible for distributing the questionnaires to its employees. The agency was given the choice to have their questionnaires delivered to one location or to give Statistics Canada a list of addresses and contacts for local distribution. The recommended target date for distribution of the questionnaires to all employees was November 2, 2005. However, the actual process was left to the discretion of the agency.

Once completed, the questionnaire was returned directly to Statistics Canada in a postage-paid return envelope. Statistics Canada accepted completed questionnaires for several weeks following the established survey period of November 2 to December 20, 2005. The closing date for acceptance of questionnaires was January 12, 2006. The CRA was asked to remind its employees to complete the survey and to return their questionnaires as soon as possible.

View the Questionnaire(s) and reporting guide(s) .

Error detection

The data capture of the approximately 27,108 questionnaires received was done between November 2005 and January 2006. The data were captured using imaging and automated data entry technology. A small proportion of questionnaires, those that could not be read by the optical scanners, were captured using heads-down keying by experienced operators. Standard quality control measures were used to verify the error rate of the capture operations. For the Canada Revenue Agency Employee Survey, based on the quality control sample that was selected, it was determined that the overall data capture error rate did not exceed 0.5%.

The data were processed by applying edit rules to identify missing, invalid or inconsistent data. Each question was examined to verify the presence of a valid code. If none was present then a "Not stated" response code of "9" was assigned. For example, an edit rule was applied that examined the flow of data from Question 99 to Question 100. Depending on the response to Question 99, superfluous data that did not respect the flow of data were eliminated.

As well, data inconsistencies were corrected. Some verification was done to match the province of work and the work unit. An edit was applied in the National Capital Region (NCR) where respondents coded their province of work as being Ontario or Quebec instead of the separate NCR code. In other cases, when regions were identified separately, the agency was consulted and when applicable, personnel in the Regions were recoded to a regional unit.

Imputation

This methodology type does not apply to this statistical program.

Estimation

The weight calculated for this survey can be thought of as re-weighting the respondents so that the respondent and population distributions have the same overall distribution with respect to the occupational group. Simply put, if 20% of the employees in the agency are in a particular occupational group, then the weight ensures that this occupational group represents 20% of the number of respondents when tabulating the data. In other words, the weight compensates for the over and under representation of occupational groups. For occupational groups that were over represented, the weights are smaller than one. For occupational groups that were under represented, the weights are greater than one.

That is, if the weight is larger than one then each person represents, besides himself or herself, other persons who did not respond. This weight indicates that the occupational group was under represented within the agency. For example, if the weight is 2, each person represents 2 persons in the population.

The weighting step calculates this number for each record. This weight must be used to derive estimates from the microdata file.

For example, if the number of respondents who "Strongly agree" with the statement "I am proud of the work carried out in my work unit" is to be calculated, it is done by selecting the records for those respondents (Q33= 1) and summing the weights.

Note that the sum of the weights is equal to the total number of responses. That is, the weights do not sum to the population counts. Therefore, when releasing demographic estimates no statements to that effect can be made.

Quality evaluation

This survey is a census and therefore, there is no error due to sampling. However, the survey is subject to non-sampling errors such as non-response or other non-sampling errors that may occur at almost every phase of a survey operation. Respondents may make errors in answering questions, the answers may be incorrectly captured and errors may be introduced in the processing and tabulation of the data.

Quality assurance and control methods were implemented according to Statistics Canada's standard practices at each step of the data collection and processing cycle to monitor the quality of the data. These measures included focus group testing to detect problems of questionnaire design or misunderstanding of instructions, and using edit rules designed to detect missing, invalid or inconsistent data.

Disclosure control

Statistics Canada is prohibited by law from releasing any information it collects which could identify any person, business, or organization, unless consent has been given by the respondent or as permitted by the Statistics Act. Various confidentiality rules are applied to all data that are released or published to prevent the publication or disclosure of any information deemed confidential. If necessary, data are suppressed to prevent direct or residual disclosure of identifiable data.

No public use microdata file will be produced by Statistics Canada and data will not be made available through the Data Liberation Initiative (DLI).

Revisions and seasonal adjustment

This methodology type does not apply to this statistical program.

Data accuracy

The target population for 2005 consisted of 37,212 individuals. The overall response rate for the 2005 Canada Revenue Agency Employee Survey was 71%.

Date modified: