Monthly Survey of Manufacturing (MSM)
Detailed information for July 2004
The Monthly Survey of Manufacturing (MSM) publishes statistical series for manufacturers -- sales of goods manufactured, inventories, unfilled orders and new orders.
Data release - September 15, 2004
- Questionnaire(s) and reporting guide(s)
- Data sources and methodology
- Data accuracy
The MSM publishes the values (in Canadian dollars) of sales of goods manufactured, inventories and orders. The MSM data are used as indicators of the economic condition of manufacturing industries; as inputs to Canada's Gross Domestic Product; as components in the Statistics Canada (STC) composite indicator; as input to economic studies, and in econometric models (e.g. to determine market share, apparent domestic availability, etc.). Results from this survey are used by both the private and public sectors including finance departments of the federal and provincial governments, the Bank of Canada, Industry Canada, the System of National Accounts, the manufacturing community, consultants and research organizations in Canada, the United States and abroad, and the business press.
Reference period: Month
Data sources and methodology
The target population consists of incorporated and non-incorporated establishments primarily engaged in manufacturing.
In 1999, the Monthly Survey of Manufacturing (MSM) has undergone an extensive redesign. A review of user requirements was first initiated. Then, with these requirements in hand, a survey was conducted in order to ascertain respondent's ability to report existing and new data. The study was also to confirm that respondents understood the definitions, which were being asked by survey analysts. The result of the concept review was a reduction of the number of questions for the survey from sixteen to seven. Most of the questions that were dropped had to do with the reporting of shipments for work that was partially completed.
This is a sample survey with a cross-sectional design.
Since 1999, Statistics Canada's Business Register provides the sampling frame for the Monthly Survey of Manufacturing (MSM). The target population for the MSM consists of all statistical establishments on the business register that are classified to the manufacturing sector. The sampling frame for the MSM is determined from the target population after subtracting establishments that represent the bottom 2% of the total manufacturing shipments estimate for each province. These establishments are excluded from the frame so that the sample size can be reduced without significantly affecting quality.
The MSM sample is a representative sample comprised of approximately 11,000 establishments.
Prior to selection, the sampling frame is subdivided into industry-province cells. For the most part, North American Industry Classification System (NAICS) codes are used. Depending upon the number of establishments within each cell, further subdivisions are made to group similar sized establishments together (called stratum). An establishment's size is based on its most recently available annual shipments or sales value.
Each industry by province cell has a 'take-all' stratum composed of establishments sampled each month with certainty. This 'take-all' stratum is composed of establishments that are the largest statistical enterprises, and have the largest impact on estimates within a particular industry by province cell. These large statistical enterprises are found in the top 45% of the national manufacturing shipment estimates.
Each industry - province cell can have at most three 'take some' stratums. Not all establishments within these stratums need to be sampled with certainty. A random sample is drawn from the remaining strata. The responses from these sampled establishments are weighted according to the inverse of their probability of selection.
An initial sample was drawn in 1998, when the survey was converted to NAICS. This sample is refreshed each month by including a sample of the birth in the population. Every three years, all establishments in the sample are re-stratified to take into account changes in their value of shipments, dead units are removed from the sample and some small units are rotated out, while others are rotated into the sample.
Responding to this survey is mandatory.
Data are collected directly from survey respondents and extracted from administrative files.
Basic collection, data capture, preliminary edit and follow-up of non-respondents are primarily performed by staff in the Statistics Canada regional offices. Sampled companies are contacted either by mail or telephone, whichever they prefer. Data capture and preliminary editing are performed simultaneously to ensure the validity of the data. Companies from which no response has been received or whose data may contain errors, are followed-up immediately.
View the Questionnaire(s) and reporting guide(s) .
There are edits built into the data capture application to compare the entered data against unusual values, as well as to check for logical inconsistencies. Whenever an edit fails, the interviewer is prompted to correct the information (with the help of the respondent when necessary). For most edit failures the interviewer has the ability to override the edit failure if they cannot resolve the apparent discrepancy.
Once the data are received back at head office, an extensive series of processing steps are undertaken to thoroughly verify each record received. Edits are performed at a more aggregate level (industry by geographic level) to detect records which deviate from the expected, either by exhibiting large month-to-month change, or differing significantly from the remaining establishments. All data failing these edits are subject to manual inspection and possible corrective action.
Imputation is required for each characteristic in the constant sample panel for which no report has been received. These are calculated automatically, subject to certain constraints, by applying to previously used values, the month-to-month and year-to-year changes in similar values of responding firms.
Estimates are produced based on returns from a sample of manufacturing establishments in combination with administrative data for a portion of the smallest establishments. The survey sample includes 100% coverage of the large manufacturing establishments in each industry by province, plus partial coverage of the medium and small-sized firms. Combined reports from multi-unit companies are pro-rated among their establishments and adjustments for progress billings reflect revenues received for work done on large item contracts. Approximately 2,500 of the sampled medium and small-sized establishments are not sent questionnaires, but instead their sales of goods manufactured are derived by using revenue from the GST files. The portion not represented through sampling -- the take-none portion - consist of establishments below specified thresholds in each province and industry. Sub-totals for this portion are also derived based on their revenues.
Industry values of sales of goods manufactured, inventories and unfilled orders are estimated by first weighting the survey responses, the values derived from the GST files and the imputations by the number of establishments each represents. The weighted estimates are then summed with the take-none portion. While sales of goods manufactured estimates are produced by province, no geographical detail is compiled for inventories and orders since many firms cannot report book values of these items monthly.
The new orders series by industry are derived by adding the change in unfilled orders over a period to sales of goods manufactured within that period.
The final data sets are subject to rigorous analysis that includes comparison to historical series and comparisons to other sources of data in order to put the economic changes in context. Information available from the media, other government organizations and economic think tanks is also used in the validation process.
Statistics Canada is prohibited by law from releasing any information it collects which could identify any person, business, or organization, unless consent has been given by the respondent or as permitted by the Statistics Act. Various confidentiality rules are applied to all data that are released or published to prevent the publication or disclosure of any information deemed confidential. If necessary, data are suppressed to prevent direct or residual disclosure of identifiable data.
Confidentiality analysis includes the detection of possible direct disclosure, which occurs when the value in a tabulation cell is composed of a few respondents or when the cell is dominated by a few companies.
Revisions and seasonal adjustment
Monthly, preliminary estimates are provided for the reference month with revised estimates, based on late responses, for the previous 3 months. Annually, benchmarking to the Annual Survey of Manufactures necessitates revisions to monthly data back to January of the benchmark year. The estimates are revised annually in accordance with the latest available data from the ASM.
While considerable effort is made to ensure high standards throughout all stages of collection and processing, the resulting estimates are inevitably subject to a certain degree of non-sampling error. Non-sampling error is not related to sampling and may occur for many reasons. For example, non-response is an important source of non-sampling error. Population coverage, differences in the interpretations of questions and mistakes in recording, coding and processing data are other examples of non-sampling errors.
Non-sampling errors are controlled through a careful design of the questionnaire, the use of a minimal number of simple concepts and consistency checks. Measures such as response rates are used as indicators of the possible extent of non-sampling errors.
The MSM's average weighted response rate for collected shipment data is in the range of 96% to 98%. Table 2 in the 'Concepts, Definitions and Data Quality' document shows weighted response, imputation and editing rates, for the following five characteristics: shipments, raw materials, goods in process, finished products and unfilled orders.
Sampling error can be measured by the standard error (or standard deviation) of the estimate. The coefficient of variation (CV) is the estimated standard error percentage of the survey estimate. Estimates with smaller CVs are more reliable than estimates with larger CVs. Table 1 in the 'Concepts, Definitions and Data Quality' document shows the national level CVs for the following five characteristics: shipments, raw materials, goods in process, finished products and unfilled orders.
- Monthly Survey of Manufacturing (MSM) - July 2004 - Concepts, Definitions and Data Quality