Biennial Drinking Water Plants Survey (DKWP)

Detailed information for 2017

Status:

Active

Frequency:

Every 2 years

Record number:

5149

The Survey of Drinking Water Plants is conducted to provide Canadians with national and regional information related to the production of drinking water.

Data release - June 11, 2019

Description

The survey is a census of drinking water plants serving 300 or more people, and asks for information on volumes of water treated, type of treatment and financial aspects of the operation. The survey results produce a national portrait of potable water production, treatment processes and costs. These data will be used to track the state of water stocks on a regional basis in Canada, and will also be used in the development of environmental accounts.

Reference period: Calendar year

Collection period: February through June of the year after the reference period.

Subjects

  • Environment
  • Environmental quality
  • Natural resources

Data sources and methodology

Target population

The target population is composed of drinking water treatment plants that are licensed and regulated by provincial/territorial agencies (excluding First Nations communities) and that draw and process source/raw water from the environment to produce treated/potable water for consumption, serving 300 or more people.

The observed population comes from a frame created in 2007. At that time, Statistics Canada requested the inventories of drinking water plants held by the provinces and territories. It excludes systems that supply water to communities with less than 300 people and other regulated systems that service schools, campgrounds, commercial establishments, provincial parks, etc. This frame is kept up to date using responses from previous survey cycles and through contact with potential respondents prior to sending out the questionnaire of each new cycle.

Instrument design

Environmental Accounts and Statistics Division, in consultation with the Questionnaire Design Resource Centre, conducted testing of the questionnaire in July, September and October 2007 across Canada which included Atlantic Canada (5 locations), Québec (6 locations), Ontario (7 locations) and Western Canada (6 locations). Working group meetings were held with representatives of Environment Canada and Health Canada and final changes to the questionnaire were made based on the results of the field testing. The revised 2011 questionnaire was tested in both official languages in the fall of 2010 at 9 locations (5 in Ontario and 4 in Québec). The revised 2013 questionnaire was not tested because the only changes made were to remove or restrict the scope of some questions. The revised 2015 questionnaire was tested in both official languages in the summer of 2014 at 19 locations (7 in New Brunswick, 6 in Ontario and 6 in Western Canada).

The 2017 questionnaire was redesigned so that respondents with multiple water treatment facilities can report the combined total of all their facilities in one questionnaire (the exception being owners with facilities in different drainage regions). The revised 2017 questionnaire was tested in both official languages in the autumn of 2016 and winter of 2017 at 17 locations (5 in New Brunswick and 12 in Ontario). In order to align with the Integrated Business Statistics Program (IBSP), an electronic questionnaire (EQ) was used for the first time for the survey.

Sampling

This survey is a census with a cross-sectional design.

Data are collected for all units of the target population; therefore, no sampling is done.

Survey frame
The survey frame was created in 2007. At that time, Statistics Canada requested the inventories of drinking water plants held by the Provinces and Territories. The frame is kept up to date using responses from previous survey cycles and through contact with potential respondents prior to sending out the questionnaire of each new cycle.

Excluding systems that supply water to communities with less than 300 people and other regulated systems that service schools, camp grounds, commercial establishments, provincial parks, etc., a survey frame of approximately 2,000 drinking water facilities serving communities of 300 or more people was compiled, the majority being public (municipal) systems.

Data sources

Data collection for this reference period: 2018-02-14 to 2018-06-26

Responding to this survey is mandatory.

Data are collected directly from survey respondents and extracted from administrative files.

Data are collected using English and French electronic questionnaires. Respondents are contacted by email or letter and given an access code for the electronic questionnaire for the survey. The questionnaires are addressed to a contact person who is either responsible for, or has knowledge of, the drinking water plants being surveyed.

Telephone and fax follow-up are used to obtain data from respondents who returned incomplete questionnaires or who failed to respond. A capture and edit software is applied to run edit checks on the data, which serve to identify real or potential response errors.

The use of administrative data to replace or complement survey data is a priority for Statistics Canada. Efforts to achieve this goal involve the Survey of Drinking Water Plants where respondents in Québec are not surveyed by Statistics Canada. Instead, the data are collected by an existing survey administered by the Québec Ministère des Affaires municipales et de l'Occupation du territoire and the results are shared with Statistics Canada in accordance with section 13 of the Statistics Act. The micro data for Québec respondents are merged and processed with the survey data collected by Statistics Canada.

View the Questionnaire(s) and reporting guide(s) .

Error detection

Many factors affect the accuracy of data produced in a survey. For example, respondents may have misinterpreted questions, answers may have been incorrectly entered on the questionnaires, and errors may have been introduced during the tabulation process. Every effort was made to reduce the occurrence of such errors in the survey.

Returned data are first checked using the edit software. This procedure verifies that all core cells have been filled in, that certain values lie within acceptable ranges, that questionnaire flow patterns have been respected, and that totals equal the sum of their components. Collection officers evaluate the edit failures and concentrate follow-up efforts accordingly. Phone follow-ups are performed to verify information in cases where edit checks fail.

If a record had no response for at least one mandatory cell after editing, the record was considered a total non-response and then was imputed.

Further data checking is performed by subject matter officers who review returned data that have been identified statistically as outliers. Comparison with data from previous years is carried out to determine if the differences between years are reasonable. In some instances, collection officers are asked to confirm responses with the respondents. Subject matter officers also research drinking water plants (annual reports, web sites, etc.) in an effort to verify information submitted by respondents.

Outlier values were identified after collection and reviewed by the client division for verification. Only real outliers were removed from the imputation process.

Imputation

Statistical imputation is used for partial non-response records. Seven methods of imputation are used for the Survey of Drinking Water Plants:

- deductive imputation (only one possible value for the field to impute)
- trend imputation
- imputation by current ratio
- donor imputation (using a "nearest neighbour" approach to find a valid record that is most similar to the record requiring imputation in terms of treated water volume and other characteristics)
- imputation by historical value (use of data from previous cycle) and
- manual imputation.

The criteria for ratio and donor imputation are various combinations of type of owner (number of facilities), water treatment type, source water type, geographical location (province, region, or Canada), and population size. All of these methods are implemented using the Statistics Canada generalized edit and imputation system (BANFF).

Estimation

Totals and ratios were estimated by the Generalized Estimation System (GES).

Quality evaluation

Micro data evaluation and error detection are important processes used to ensure good quality data. However, the final estimates obtained through the use of this micro data must also be evaluated in order to ensure accuracy. The quality of the estimates produced from a survey can be assessed through comparison to the trends obtained from other data sources and/or through a historical comparison to data obtained previously through the same survey. Estimates for the Survey of Drinking Water Plants were compared with the estimates from previous reference periods. This historical comparison was made to ensure that the estimates were coherent.

Disclosure control

Statistics Canada is prohibited by law from releasing any information it collects which could identify any person, business, or organization, unless consent has been given by the respondent or as permitted by the Statistics Act. Various confidentiality rules are applied to all data that are released or published to prevent the publication or disclosure of any information deemed confidential. If necessary, data are suppressed to prevent direct or residual disclosure of identifiable data.

A discretionary disclosure order (DDO) pursuant to paragraph 17(2)(a) of the Statistics Act was obtained to allow increased disclosure of aggregate information. The DDO permits the release of drinking water data, allowing the dissemination of a complete national profile of information related to the production of drinking water.

Revisions and seasonal adjustment

Revisions are made for the previous survey reference period, with the initial release of the current data, as required. The purpose is to address any significant issues with the data that were found between survey cycles. The actual period of revision depends on the nature of the issue. For the most current data please refer to tables 38100009, 38100092, 38100093, 38100094, 38100103, 38100269, 38100270, 38100271, 38100272. The data are not seasonally adjusted.

Data accuracy

Sampling error can arise when the information obtained from a sample of a population is used to derive an estimate for the entire population. Since the Survey of Drinking Water Plants is a census, sampling error is null.

Response error may be due to questionnaire design, the characteristics of a question, inability or unwillingness of the respondent to provide correct information, misinterpretation of the questions or conceptual problems. These errors are controlled through careful questionnaire design and testing and the use of simple concepts and consistency checks.

Processing errors may occur at various stages of processing such as data editing and tabulation. All efforts are undertaken to minimize non-sampling errors through extensive edits, quality control steps and data analysis, but some of these errors are outside the control of Statistics Canada.

Non-response errors result when respondents refuse to answer, are unable to respond or are too late in reporting. Missing data items are imputed for partial and total non-responses.

Since this statistical activity is a census and all non-response has been imputed, the sampling error is zero (0) which give a CV of zero (0). To take into account that imputation has occurred, both the sampling error (which is 0 for every estimate) and the non-response rate are combined into one quality rating code for each estimate. This code uses letters that range from A to E where A means the estimate is of excellent quality and E means it is to be used with caution.

A: excellent data quality (CV is 0 and non-response rate is 10% or lower)
B: very good data quality (CV is 0 and non-response rate is 10.01% to 33%)
C: good data quality (CV is 0 and non-response rate is 33.01% to 60%)
E: use with caution (CV is 0 and non-response rate is greater than 60%)

The weighted total potable water production response rate for 2017 was 97%.

NOTE: Readers are advised, with the change in data collection for Québec respondents, comparisons from a time series perspective should be made with caution.

Date modified: