National Population Health Survey: Health Institutions Component, Longitudinal (NPHS)
Detailed information for 1996/97
Status:
Inactive
Frequency:
Every 2 years
Record number:
5003
The NPHS Health Institutions Component survey data support national level estimates only.
Data release - June 25, 1999
- Questionnaire(s) and reporting guide(s)
- Description
- Data sources and methodology
- Data accuracy
- Documentation
Description
In the fall of 1991, the National Health Information Council recommended that an ongoing national survey of population health be conducted. This recommendation was based on consideration of the economic and fiscal pressures on the health care systems and the commensurate requirement for information with which to improve the health status of the population in Canada. Commencing in April 1992, Statistics Canada received funding for development of a National Population Health Survey Health (NPHS) Institutions component.
The NPHS collects information related to the health of the Canadian population and related socio-demographic information. It is composed of three components: the Household, the Health Institutions and the North components.
To obtain a comprehensive picture of Canadians' health, a special survey was developed for people living in health care institutions--hospitals, nursing homes, and residential facilities for people with disabilities.
The content of the NPHS Health Institutions component was selected according to the following criteria:
- the survey should collect information on the health status of the Canadian population residing in health institutions;
- the data collected should be comparable to that of the household population whenever possible;
- the survey should increase the understanding of conditions relating to institutionalization;
- information provided should permit the study, over time, of the transitions from households to institutions and vice versa;
- the survey should produce national level data.
The Health Institutions component started in 1994-1995 and has been conducted every two years. The first two cycles (1994-1995 and 1996-1997) were both cross-sectional and longitudinal. Beginning in Cycle 3 (1998-1999) the survey became strictly longitudinal (i.e. collecting information from the same individuals each cycle). After five cycles of collection, the institutions component has ended.
The NPHS Health Institutions component data are primarily used to study prevalence and incidence of disease, to make projections and perform demographic trend analyses. The data are used by the research community and other health professionals.
Reference period: Varies according to the question (for example: "over the last 12 months", "over the last 6 months", "during the last week",
Subjects
- Disability
- Diseases and health conditions
- Health
- Health and disability among seniors
- Health care services
- Older adults and population aging (formerly Seniors)
Data sources and methodology
Instrument design
Each NPHS cycle questionnaire is conceived in collaboration with specialists from Statistics Canada, Health Canada, provincial ministries of health and researchers from the academic fields. The questionnaire development involves an elaborate literature research and numerous consultations between specialists in order to adapt existing survey instruments from other well-known sources, or to create new ones especially for the NPHS. Every questionnaire is approved by members of the expert committees and the Advisory Committee, which includes representatives from the provincial ministries of health, Health Canada, Statistics Canada, other government departments and specialists. The health institution component questionnaire was slightly modified between the first three cycles but remains basically the same since Cycle 3.
Sampling
This is a sample survey with a longitudinal design.
In the first cycle of the NPHS Health institution component, the sample was created by first selecting institutions and then residents within these institutions (Consult the sample design chapter of the NPHS Health Institution Component, Cycle 1 user Guide in the Documentation section). For the second cycle, a distinction is made between the sample selected for longitudinal purposes and the sample selected for cross-sectional purposes..
The cross-sectional sample consists of following-up the longitudinal respondents and selecting a supplementary cross-sectional sample. The longitudinal sample for 1996-97 consists of all longitudinal respondents chosen in Cycle 1 who had responded to the questionnaire in 1994-95. For health institutions, the attrition of the sample is expected to be much higher than for people living in private households. The sample attrition of selected residents of health institutions is mainly due to the death of longitudinal panel members. Since the decrease in sample size is substantial, it can lead to large increases in the variance estimates if no additional sample is selected. Moreover, in order to maintain cross-sectional representativity of the sample, a sample of newly admitted residents in Cycle 1 institutions and a top-up sample of new institutions must be drawn.
The 1996 sample frame was generated from the 1995 list of residential care facilities collected by the Canadian Institute for Health Information (CIHI) and the 1993 list of hospitals maintained by the Health Statistics Division (HSD) of Statistics Canada. Provincial Ministries of Health verified and updated these lists to ensure their accuracy. The creation of the 1996 frame is based upon the same criteria and stratification used for the 1994 frame. The same stratification (geographic region, type of institution, number of beds) as that used in Cycle 1 was kept to classify the new health care facilities. Based on the information provided by the follow-up of the longitudinal panel members, we decided how many extra residents needed to be interviewed in each Cycle 1 institution, and an additional sample of residents was randomly selected. The sample size of the top-up sample in each Cycle 1 institution depends upon the sample attrition for that institution, the number of long-term residents in 1996, and the corresponding 1994 sampling fraction. For each new institution, the sample size was first set to the number of residents sampled per institution in 1994 for that stratum. The sample size was then adjusted to account for non-response at the person level. That adjustment was based on the Cycle 1 individual response rate, which was 93.6%.
The follow-up of the longitudinal respondents and the selection of a supplementary cross-sectional sample yielded a Cycle 2 cross-sectional sample size of 2,393 from which 2,118 accepted to participate to the survey. The 1996-1997 cross-sectional sample comprises Cycle 1 institutions still in operation as well as new top-up institutions selected for Cycle 2.
The longitudinal sample for 1996-1997 consists of all longitudinal respondents chosen in Cycle 1 who had responded to the questionnaire in 1994-1995. The sample consists of 2,287 persons living in a health care institution in 1994-1995.
Data sources
Responding to this survey is voluntary.
Data are collected directly from survey respondents and extracted from administrative files.
Prior to collection, all institutions sent an introductory letter and then contacted by senior interviewers to arrange a meeting between an interviewer and the administrator of the institution. During this liaison visit the interviewer administered a short questionnaire on the policies of the institution. The residents requiring proxy interviews were determined at this time. The name and telephone number of the next-of-kin were obtained in these cases. The next-of-kin was then phoned and given the option to complete the interview primarily themselves or have it completed by a knowledgeable institutional staff member.
The NPHS Institutional component questions were designed to be conducted by personal interview (face-to-face collection) using paper and pencil. Telephone interviews were acceptable when a proxy respondent could not be contacted in person.
Interviewers were instructed to make all reasonable attempts to obtain interviews with selected residents. The administrator of the institution or a contact within the institution determined which of the selected residents required a proxy interview because of illness or incapacity. The proxy respondent could be a relative, a staff member, or a volunteer at the institution. In Cycle 2, proxy respondents completed 59.1% of the interviews (of the proxy interviews, 72.8% were done by relatives of the resident).
In Cycle 2, most interviews were conducted in person. The total interview took an average of 37 minutes for non-proxy and 32 minutes for proxy respondents.
The resident questionnaire (Form 6) was captured using the Optical Coding Text Recognition (OCTR) process. In this process the questionnaires are scanned with an optical reader. If a check box had at least 3% of the area marked, the information in this field was captured. If more than one box was checked for mark-one only questions, an operator looked at the scanned image to determine which one was the correct value. If the correct value was not obvious, the value of the second response was taken. When the scanner was not 90% certain of a write-in response, an operator who manually viewed the scanned image on a computer screen verified it. The unique identifier and names of medications were 100% verified by the operator.
The Institution Policy Questionnaire (Form 5) was captured manually. The information was 100% verified because of the small number of records.
Conditions or health problems causing activity restrictions were coded based on the International Classification of Diseases, 9th Revision (ICD-9) or according to the Musculoskeletal Impairment Supplementary Coding Scheme developed for the Health and Activity Limitation Survey (HALS). Drugs and medications were coded using a revised version of the Canadian Anatomical Therapeutic Chemical Classification System (ATC) developed by Health Canada.
View the Questionnaire(s) and reporting guide(s) .
Error detection
After completing an interview, the interviewer reviewed the questionnaire to ensure the skip patterns were correctly followed. Further editing was done at the Regional Offices to check for completeness, legibility and consistency of entries on the questionnaire. This allowed for immediate follow-up with the respondents.
After data capture, top-down editing was performed on all records to check the skip patterns.
Imputation
Imputation was used to derive the missing values for one variable in the NPHS Health Institutions component. The variable HSIxDHSI denotes the respondent's Health Utility Index (HUI). This measure of overall health status assesses vision, hearing, speech, getting around (ability to move about), dexterity (movement of hands and fingers), feelings, cognitive ability (memory and thinking) and pain. The overall HUI rating, which can range from -0.360 to 1.000 is calculated based on responses to a series of questions on health status. However, this overall rating cannot be calculated if one or more of the answers are missing. It was decided to use imputation for the missing values in order to calculate the HUI of the health care institutions component.
The HUI was calculated based on the answers to questions on the eight elements in the health status section. A partial rating was calculated for each of the elements and then further calculations were done on these partial ratings to derive the overall HUI rating. Imputation was at the level of the eight partial ratings rather than the questions. After imputation, the program for calculating the derived HUI variable was changed slightly so that it selected as entry data the eight imputed values for vision, hearing, speech, getting around, feelings, cognitive ability, dexterity and pain.
Imputation was done in two stages:
- The first stage used a deterministic imputation. In some instances, even if the person did not answer the question providing the partial rating, there was sufficient information to deduce the partial rating with certainty. Therefore, a partial rating based on this partial information was attributed in all instances where it was considered appropriate to do so.
- The second stage corresponds to a hot deck donor imputation to attribute the missing partial ratings. The nearest neighbour method was used to identify the donors. The nearest neighbour was determined by calculating a temporary HUI, using only the partial ratings containing only valid values.
Estimation
Estimation from NPHS data is done using the sampling weights provided with each data set. These weights are computed using an approach where an initial weight representing the inverse probability of selection is computed. This weight is then adjusted to take into account the various specifics of the survey. The typical adjustment is the one to compensate for non-response. The CHAID algorithm is used to determine which variables best characterize the response groups. Once the adjustments have been made, the last step consists of post-stratifying the weights. This post-stratification is done to insure consistency with the Census-based population estimates. Since the total number of people in Canada living in a health care institution is unknown (based on the institution definition in the NPHS), it is impossible to perform a post-stratification based on these totals. However, post-stratification is done using the total weights obtained in Cycle 1. Post-stratification is done in two steps: first, for each of the five regions and then for each type of institution and age-sex category.
Also, for each of the sampling weights computed for the group of respondents in each cycle, a "share" version of the weight is also computed. This share weight is given only to those respondents who agreed to share their data with the survey partners (typically Health Canada and the various provincial health ministries). The computation of this weight involves the redistribution of the weights of the non-sharers to the sharers using a similar approach to that of the non-response adjustment. Since the share partners only have access to the share data, they must use the share weights for estimation.
For the first two cycles of the NPHS Health Institution component (1994-1995 and 1996-1997), a well-known, simple variance formula was used to compute the variances and the CVs of estimates. It assumes that institutions are selected with unequal probabilities and with replacement. In reality, the institutions were selected without replacement, that is, once selected, an institution could not be chosen a second time. A variance computation program written in SAS and SPSS is provided along with the microdata files. This program can be used to calculate variances for means and totals.
For the third (1998/1999), fourth (2000/2001) and fifth (2002/2003) cycles, the NPHS Health Institution component used the bootstrap method to calculate the variance. This method takes the complexities of the survey design into account, as well as the various adjustments to the weights during the weighting process. A set of bootstrap weights is available with the data files to calculate the variances. Note that the Bootvar program, a program made up of macros available in SAS and SPSS, is distributed with the bootstrap weights in order to calculate the variances with this method.
Quality evaluation
Survey design has a profound effect on the objectives of the survey which are listed under "Survey Description". To meet these objectives, a Steering Committee and an Advisory Board comprised of authorities from the provincial Ministries of Health and Health Canada determined the concepts and focus. Expert Groups were convened to advise on the measures to obtain the results envisioned by the Steering Committee and Advisory Board, and to recommend proven collection vehicles and indices. The resulting data is recognized as valid measures of contemporary concepts such as: depression, activity limitation, weight problems and chronic pain.
High response rates are essential for quality data. To reduce the number of non-response cases, the interviewers are all extensively trained by Statistics Canada, provided with detailed Interviewer Manuals, and are under the direction of interviewer supervisors. A maximum recommended assignment size by interviewer was calculated based on test results. Interviewers make every effort to contact respondents.
Refusals were followed up by senior interviewers, project supervisors or by other interviewers to encourage respondents to participate in the survey. In addition, to maximize the response rate, non-response cases were also followed up in subsequent collection periods.
Disclosure control
Statistics Canada is prohibited by law from releasing any data which would divulge information obtained under the Statistics Act that relates to any identifiable person, business or organization without the prior knowledge or the consent in writing of that person, business or organization. Various confidentiality rules are applied to all data that are released or published to prevent the publication or disclosure of any information deemed confidential. If necessary, data are suppressed to prevent direct or residual disclosure of identifiable data.
In Cycles 1 and 2 of the NPHS Health Institutions, Public Use Microdata Files (PUMFs) were produced in addition to the Master files. The PUMFs differ in a number of important aspects from the survey 'master' files held by Statistics Canada. These differences are the result of actions taken to protect the anonymity of individual survey respondents. First, only cross-sectional data are available on such files, because longitudinal information can lead to the identification of respondents. Also, some sensitive variables are regrouped, capped or completely deleted from the files. All the PUMFs must be approved by the Microdata Release Committee before their release.
Users requiring access to information excluded from the microdata files may purchase custom tabulations, or access the master files through the Research Data Centres program or the Remote Access program. Outputs are vetted for confidentiality before being given to users.
Before releasing and/or publishing any estimate from these files, users should first determine the number of sampled respondents who contribute to the calculation of the estimate. If this number is less than 30, the weighted estimate should not be released regardless of the value of the coefficient of variation for this estimate. For weighted estimates based on sample sizes of 30 or more, users should determine the coefficient of variation of the rounded estimate and follow the guidelines below.
Estimates in the main body of a statistical table are rounded to the nearest hundred units using the normal rounding technique. If the first or only digit dropped is zero to four, the last digit retained is not changed. If the first or only digit dropped is five to nine, the last digit retained is raised by one. Marginal sub-totals and totals in statistical tables are derived from their corresponding unrounded components and then are rounded themselves to the nearest 100 units using normal rounding methods. Averages, proportions, rates and percentages are computed from unrounded components (for example, numerators and/or denominators) and then are rounded themselves to one decimal using normal rounding. In normal rounding to a single digit, if the final or only digit dropped is zero to four, the last digit retained is not changed. If the first or only digit dropped is five to nine, the last digit retained is increased by one. Sums and differences of aggregates (or ratios) are derived from their corresponding unrounded components and then are rounded themselves to the nearest 100 units (or the nearest one decimal) using normal rounding. Under no circumstances are unrounded estimates, published or otherwise, released. Unrounded estimates imply greater precision than actually exists
Revisions and seasonal adjustment
This methodology does not apply to this survey.
Data accuracy
Two separate response rates are calculated for the NPHS Health Institution component. The institutions response rate corresponds to the percentage of in-scope institutions that agreed to have the survey conducted among their residents and the individual response rate corresponds to the percentage of selected residents from the responding institutions with whom an interview was conducted.
Cycle 2 Cross-Sectional Institution response rate: 100.0%
Cycle 2 Cross-Sectional Individual response rate: 89.9%
Cycle 2 Longitudinal Institution response rate: 100.0%
Cycle 2 Longitudinal Individual response rate: 95.9%
Documentation
- NPHS (Cycle 2) 1996-1997: Topical Index
- NPHS (Cycle 2) 1996-1997: User Guide
- NPHS (Cycles 1 to 5) 1994-1995 to 2002-2003: Derived Variable Documentation
- Date modified: