The FY2020 Administrative Entity data file reported data on 9,245 libraries. Of those, 17 were closed or temporarily closed for FY2020. The additional 9,228 libraries brings PLDF3 to a total observations to 303,851. Each observation is the data for one library system for one year.
There were two FSCSKEY data anomalies in Oregon's data. Siletz Public Library reported from FY1987 through FY1998 (in FSCSKEYs: OR0102 and OR0077), then not again until FY2020 when it was given the FSCSKEY OR9017. The newkey for this library is changed to OR9017. The second one was one I have missed: Ione Public Library It reported in FY1987, paused until FY2013 and has reported regularly since then. The FY1987 FSCSKEY for this library was assigned to another library in FY1988 and I gave it a newkey out of range as discussed in the documentation of newkeys. This year, I noticed that I had missed connecting the FY1987 data with the run from FY2013 through FY2020 and changed the newkey of the 1987 Ione Public Library in order to join its data with those of the other years.
The FY2019 data reported 9,260 libraries. 19 of these libraries were closed or temporarily closed and were deleted from PLDF3. 9,241 libraries are added to PLDF3 for a total of 294,623 libraries in the dataset. We are likely to hit 300,000 with the next set of data.
There was one data anomaly. Tioga Community Library in Tioga, North Dakota reported data this year under the FSCSKEY 'ND0110'. Tioga Community Library also reported from 1988-1990 under FSCSKEY 'ND0081'. I wrote Mrs. Clarke who is the librarian who gave me an interesting and informative answer. The library had been closed because of space and other considerations but materials had been put in storage until the library could be restarted, which we see has happened. Many details have changed, of course, but institutionally, it is the same library, and they have added many new materials. It looks like a nice library from the pictures. The newkey 'ND0110' has been assigned to this library.
The note below for 5/12/04 dealt with a decision about what to do with the data for Minnesota's public libraries for 2001. During Governor Ventura's administration, the data for Minnesota's libraries were not collected during that year. After that, at a meeting, I asked the representatives from Minnesota if those data could be reconstructed...were they collected and just not published? No, there were no data and there was no way to create them. In recompiling those data for Minnesota as a part of this project, I dropped the 2001 data for Minnesota. As I note below, I have rethought this decision. There are data there but they are not from the libraries--but there are data elements from other sources. The role of the analyst is different from that of the compiler and I now believe my compiler hat was overruled by the analyst hat–incorrectly. I have included these stub data in PLDF3 now. It is 142 libraries for this year with no data on library operations. The span variable has been left at 'E' for those Minnesota libraries that reported for all years but 2007. The Schedule of Changes for Minnesota also notes this change.
The FY 2018 data from the Public Libraries Survey had 9,281 reported libraries. 12 of those were closed or temporarily closed and were deleted from PLDF3, leaving 9,249 libraries, including four from the outlying territories to be added to PLDF3.
There were no anomalies with the FSCSKEYs.
The survey not only reports data from the public libraries in the US but also over the years of the Survey have reported data from six outlying territories for different sets of years since data on the library of the Northern Marianas reported in FY 1997. In 24 years of reporting, there have been six library systems that have reported and a total of 73 of these territories ever reported. All but Puerto Rico report the one system library. The data vary in the amount of detail they have. To summarize:
American Samoa (6), Guam (21), Northern Marianas (20), Puerto Rico (7) with a total of 368 observations, Palau (3), and the Virgin Islands (16).
In the process of this revision, I examined these data and decided I had been too restrictive in not including some in PLDF3 because of sparse data. There were 27 I had deleted from PLDF3 before this year's new data and publications were added and I included them. That fact will challenge the accuracy of counts per year recorded on this page but the corrected totals appear in the frequency tables.
The number of observations (one library for one year) in PLDF3 is 285,242 and 10,227 libraries ever reported. In FY 2018, summary data from 50 states, plus the District of Columbia and four outlying territories are in reported in the States Summary/State Characteristics data and which are collected in the PUSUM file. There are summary data from 1,450 of these ‘state’ in this file.
The FY 2017 data from the IMLS Public Libraries Survey had 9,245 reported libraries. 19 of those had STATSTRU = ‘03’ (Closed) or ‘23’—(Temporary Closure) and were dropped from PLDF3. The data from 9,216 public libraries were added to PLDF3 giving a total of 275,962 observations in the dataset.
10,181 libraries have ever reported in PLDF3.
There were three FSCSKEY anomalies created with the addition of this year's data.
The FY 2016 IMLS report had 9,252 observations. Of those 18 STATSTRU = ‘03’ (Closed) or ‘23’—(Temporary Closure). They were dropped from PLDF3. PLDF3, then, has 9,234 observations added from the FY 2016 data. The total number of observations (one library's data for one year) in PLDF3 is 266,746.
Libraries from two “outlying areas” are included: American Samoa and Guam. Puerto Rico reported no data in FY2016. It had reported steadily from FY 2008-FY 2014 but has stopped.
10,174 libraries have ever reported in this series,
There was one library an FSCSKEY anomaly which required one change in its newkey:
There were 9,251 observations in the FY 2015 data from IMLS. 18 had STATSTRU = ‘03’ (Closed) or ‘23’—(Temporary Closure). They were dropped. PLDF3, then, has 9,231 observations added from the FY 2015 data. 248,281 observations (through FY 2014) + 9,231 = 257,512 observations.
Libraries from two “outlying areas” are included: American Samoa and Guam. Puerto Rico reported no data in FY2015.
10,157 libraries have ever reported in this series,
There were two libraries with FSCSKEY anomalies and changes in newkey:
There are 9,305 observations in the FY2014 dataset. Ten of those observations had STATSTRU = ‘03’ (Closed) or ‘23’—(Temporary Closure) and were dropped. The Virgin Islands and the Marianas did not report so those two were also dropped leaving 9,293 libraries to be added to PLDF3. The number of observations in PLDF3 (one library's data for one year) is now 248,281.
10,144 libraries have ever reported.
58 Puerto Rican libraries reported in 2014, up from the 34 that originally reported in 2008. Total number of observations from Puerto Rico is now 358.
The FY 2013 data file from IMLS has 9,309 observations. 19 of those libraries have STATSTRU = ‘03’ (Closed) or ‘23’—(Temporary Closure.). After changes with the libraries from outlying areas, 9,288 libraries added to PLDF3 this year. The count of libraries with data included in PLDF3 is now 238,988.
The raw data file for FY 2012 from IMLS for the FY 2012 data has 9,305 observations (one observation per library.) Of those, 11 have STATSTRU = ‘03’ (Closed) or ‘23’—(Temporary Closure.) Other changes with libraries not reporting from outlying areas leave 9,292 libraries in the FY 2012 data in PLDF3. There are now 229,700 observations in PLDF3. There are now 10,112 libraries which have ever reported data in this series.
This year there are 252 libraries from Puerto Rico an impressive increase in their reporting.
This series gets better and better. Thanks to IMLS for the continuing and building on its strengths
The raw file for FY 2011 from IMLS has 9,315 observations or one for each library. Of those, 24 have STATSTRU = ‘03’ (Closed) or ‘23’—(Temporary Closure.) They are dropped from PLDF3, thus leaving 9,291. The Virgin Islands and the Northern Marianas did not report and are also dropped, leaving 9,289. There are 56 libraries from "outlying areas." One from Guam and 55 from Puerto Rico although a number of these Puerto Rican libraries have fragmentary data in this file. 9,289 + 211,119 = 220,408 observations total for the file. A total of 10,092 public library systems have data in this series.
The documentation has a note that there were 55 Puerto Rican libraries of which 35 reported. (p. 3) The raw file has 61 libraries in Puerto Rico but 3 have a STATSTRU of ‘03’ or '23.' Therefore, there are 55 (in the file) minus the 35 the documentation says reported leaves 20 libraries not reporting but with data in the file.
That is, there are data elements included and many of them, I suspect, are supplied not by the libraries themselves but by officials of Puerto Rico from Commonwealth-wide data. These data include such things as latitude, longitude of these libraries, and so on. But in these data, we see that almost all of these libraries with the fewest reported data elements are very small, with few staff, fewer of these staff with ALA-accredited degrees, low total circulations, and most other resources are meager. It is a bit of a puzzle about what to do. I have decided to include all. For now.
I have often thought about the matter of what is the obligation of the compiler of data? I think one principle is what I have termed the Hippocratic Oath of the data compiler: first, do no harm. In the case of our colleagues in Puerto Rican libraries, we see small libraries from which some data can be gleaned and given this is a longitudinal file—with all the baggage that fact entails—I think the lesser of many evils is to include these libraries and await further information in the years ahead.
One minor anomaly came to light but this is something I missed in last year's data. From 1988 to 1995 the Koyukuk Community Library in Koyukuk, Alaska reported data under the FSCSKEY AK0042. The library did not report from 1996 to 1998 but began, again, where its data were published from 1999 through 2004 and 2006 with the FSCKEY AK0119. Then it did not report for 2007 and 2008, reappearing in 2009 and 2010 but now back in the old FSCSKEY of AK0042. The newkey, therefore, is now AK0042 and the library's data now fall together there. The Alaska Schedule of Changes has the code changes.
The raw file from IMLS has 9,308 observations. Of those, 9 have STATSTRU = ‘03’ or ‘23’—closed. There are two observations made up of completely imputed data for the Marianas and for Palau. Thus, the number of observations in PLDF3 is 201,822 (the count through FY 2009) + 9,297 (9,308 - 11) or 211,119. Unlike in the past, there were no anomalies in earlier data which were noticed in the process of adding the FY 2010 data, so this is the count. There were just a few changes necessary in newkeys and those were all cases where a library had reported in the past and hadn't reported for a few years. When the libraries reported in FY 2010, they were assigned new FSCSKEYs. As in the past, the newkeys were made to match with the current FSCSKEYs.
Just to take a step back, the data, their documentation, and the care with which they are compiled have continued to improve. This is a most impressive series of data and one which reflects the hard and dedicated work of many people over many years.
There are now 201,822 observations in PLDF3. The FY2009 data had 9,275 open libraries reporting data. Data from one library were dropped. It had observations in 1987, 1988, and 1989. That means the revised total for the data through FY2008 is 192,547. 192,547 + 9,275 = 201,822.
The deleted observations are discussed in the Schedule of Changes to Idaho newkeys.
The count of observations in PLDF3 through FY2008 is 183,293 + 9,257 = 192,550 with 110 variables.
The base IMLS Public Library data have 9,284 public library systems reporting. Of those, 25 are library systems which have a "Structure Change Code" or STATSTRU = "3" or "Closed." This is the first year this value has been reported for this variable and the 25 libraries that are included in the base dataset in this category are excluded from PLDF3. 9,284 - 25 = 9,259.
Of these 25, 12 are in South Dakota.
The Northern Marianas and the Virgin Islands, again, did not report data and are, again, also excluded from PLDF3. 9,259 - 2 = 9,257.
For the first time in this data series, the public libraries of Puerto Rico have reported. There are data from 35 new systems to be added to this series. Bravo!
This data series continues to show improvements on many levels. It is the best public library data series we have and it has taken dedicated work of many people over many years. Here's hoping the analytical community can do its part to help practitioners.
The count of observations for PLDF3 through FY2007 is 174,079 + 9,214 = 183,293 with 108 variables.
As discussed at 12/08/07, NEWMAN TOWNSHIP LIBRARY reported twice. Rob Winner, Illinois' PLSC Data Coordinator confirmed that the data in FY2006 were reported twice and that the data in IL0377—the number used since 1988—were partial year data and that the new number, IL0694 had the full year's data. In FY2007, the data for NEWMAN TOWNSHIP are reported in IL0694 and IL0377 does not exist. For this reason, the FY2006 data are corrected in PLDF3 and the partial data for IL0377 are dropped. The data for NEWMAN TOWNSHIP will now have the newkey at IL0694. The FY2006 data, therefore, now have 9,207 observations. As noted immediately below, the three outlying areas did not report so PLDF3 for FY 2006 has the reported 9,211 - 1 (Newman Township at IL0377) - 3 (Guam, Northern Marianas, and the Virgin Islands) = 9,207. Thus, PLDF3 through FY2006 has 174,079 observations.
The FY2006 data have 9,211 observations. As in the recent past, three outlying areas: Guam, The Northern Marianas, and the Virgin Islands did not report. These observations have been dropped in PLDF3, leaving this year with 9,208 observations. PLDF3 now has 174,080 observations (9,208 + 164,782) with 101 variables.
For the most part, the data show steady improvements in the sense that data from this year are more aware of data from the last year so that anomalies caused by incorrect changes in FSCSKEYs are lower than ever. The most common such problems occurred in two states where libraries that had reported for a number of years missed FY 2005 and when they reported again, were given a new FSCKEY. These cases are handled in the FSCSKEY by changing the newkey in all other occurrences of these libraries to the latest FSCSKEY.
IL0377 has been used since 1988 for NEWMAN TOWNSHIP LIBRARY, 108 WEST YATES STREET, in NEWMAN, ILLINOIS. With variations in the LIBNAME and address over the years. This year there is IL0694 which is at the same address and phone number. It reports data that differ slightly from IL0377. The name is also slightly different. It looks to me like the person filling out the form put data in each. I think IL0694 has later data but not in all cases.
In the process of testing the ASCII file of the data (pldf3ascii.txt) with the SAS dataset, I found two duplicates: the first was for ME0242 for 1991 for which there is a complete entry and a second that appears to be a stub entry, that is, it is incomplete. Also, ME0256 for 1991 but these duplicates appear both to be complete. The stub entry for ME0242 and one of the entries for ME0256 are deleted. The count of institutions in PLDF3 is now 164,872.
My colleague, Don McMorris, found the solution to a problem that I had noticed but not understood. The 1987 data on employees were completely out of range of all other such data. Embarrassingly, he found it in the documentation for the 1987 data: the documentation make clear that the raw data for that year did not have an explicit decimal point. I missed that when I first read in the 1987 data so the number of employees in four categories were ten times the true values. That is fixed, now. There is more information on this correction in the discussion of the PLDF3 variables
The FY 2005 dataset has 9,201 observations. However, three outlying areas: Guam, The Northern Marianas, and the Virgin Islands did not report. These observations have been dropped in PLDF3, leaving this year with 9,198. There are 164,874 observations in PLDF3 now with 94 variables ever reported in the dataset—however, not all variables are reported for each year.
In reading Douglas Galbi's Audiovisual Materials in U.S Public Libraries' Collections, I noted that he reported he had trouble reading in the ASCII file of the PLDF3 data. He pointed out that the documentation of that file differed from the output program. He was right and I appreciate his reporting that problem.
At first I thought it was merely a documentation error but in checking, I found another kind of error that I had missed. In five cases, four of them dealing with staffing (MASTER, LIBRARIA, OTHPAID, and TOTSTAFF), the output program had not output numbers with explicit decimal points but, rather, had rounded the numbers. The fifth (PSUNDUP) is only reported from 1987-1989 in these data. This error is not reflected in the spreadsheets, only the ASCII file. The documentation and the ASCII file are updated today, September 7, 2007. This update is interim because we have been led to expect the FY 2005 data will be published by NCES in October.
I believe that, if anyone used this ASCII file to analyze staffing at US public libraries, the effect of this error would be greatest in the very smallest libraries. That is, if a library had .25 total staff, the ASCII file recorded 0. If it had 100.25, the file reported 100 so this rounding would appear to affect smaller libraries more than the larger ones.
Those interested in analysis of library data will find Mr. Galbi's other work of interest. See: Library and Library Use for a list of these articles on his Web page.
The Virgin Islands did not report in FY 2004 so it has been dropped from PLDF3.
The Northern Marianas did not report in 2001, 2002, nor 2004 and it was also dropped from PLDF3.
Guam did not report in 2002 nor 2004 so these observations were dropped from PLDF3.
The number of observations in PLDF3 is now 155,676.
Dropping these observations has affected the counts of observations for each year. There are now 9,207 observations in FY 2004 instead of 9,210.
The FY 2004 data had 9,210 observations. That number plus the revised number of observations of 146,472 means that PLDF3 currently has 155,682 observations. Breakdowns by state and year of these observations is available in three spreadsheets: pldf3freq.csv, pldf3freq.ods, and pldf3freq.xlxs
Price City Library, Price Utah (newkey = UT0017) had duplicate entries for 1991. They differed only in the name. One was Price City Library and the other was 'DAGGETT CO. BOOKMO' and this one was deleted.
The number of observations for PLDF3 through FY 2003 is now 146,472.
In adding the FY2004 NCES public library data to PLDF3, three duplicate entries were discovered:
The changes were handled in code in programs late in the process and the code is shown for Nebraska and New Hampshire in the Schedule of Changes pages for each state.
There are now 146,473 observations in PLDF3 for FY2003.
The FY 2003 dataset had 9,214 observations. That, plus the 137,262 from 1987-2002 gives us the current 146,476.
Palau has entries with no data in 2001 and 2002. These have been dropped. The count of observations is now 137,262.
One library was dropped from the 2002 NCES data, IL8023. This change is discussed with changes from Illinois. The number of observations in the PLDF3 dataset is 137,264. This includes the 9,140 observations added in 2002 with the 128,124 from 1987-2001.
Minnesota did not report data in 2001 but NCES published records with information on the libraries. After the imputations were removed, these became dummy records and the 140 from 2001 were discarded from PDLF3. The number of observations is now at 128,124. No Minnesota libraries will have a span of 'A' because it seems that the data for this year are lost for Minnesota public libraries.
06/30/2021I have had second thoughts about deleting these dummy data from PLDF3 and have included them as of today. There are 142 of these libraries. Analysts will need to be careful because library data on these libraries do not exist but other data such as longitude, latitude, zipcode, and the like are included. It is a knotty problem.
Indiana's zipcodes in 2001 were incorrect in the original publication of these data. NCES has updated the dataset and the various datasets here reflect the change.
There were duplicate records for the Nebraska towns of Alma (FSKSKEYs NE0006 and NE0258*), Fremont (NE0090 and NE0259*), Genoa (NE0094 and NE0260*) in 1988. In addition, Creighton (NE0062 and NE9014*) was duplicated in 2000. The asterisks indicate the observations that are deleted in PLDF3. More details on these four cases are found in the Nebraska Schedule of Changes.
There were two records for Walhalla, North Dakota in 1990, one in ND0086 and the other in ND0095. The record in ND0086 was mostly blank and appears to have been a stub record that was not filled in. ND0095 had data in it. ND0086 for 1990 was deleted in PLDF3. The number of observations is now 128,264.
In Kansas in 1991, there are 17 dummy records (KS0323 through KS0339). They are deleted in PLDF3 bringing the number of observations down to 128,269.
There are two sets of data for Elmira, New York for 1988. One has an FSCSKEY of NY0100 and the other NY0101. In comparing the two, it appears that the data in NY0100 are incomplete and appear to have been a mistake. For instance, in 1987 and 1989, there are four branch libraries while in the NY0100 data, there are 0. In fact, there are many 0s in this set of data. The years 1987, 1989-1990 have an FSCSKEY of NY0101 and the data behave reasonably year to year if the 1988 NY0101 data are used. The NY0100 data are deleted in PLDF3. In 1991, the FSCSKEY for this library was changed to NY0765 and its newkey for all years is now NY0765.
The count of observations is now 128,286.
The data for Wedsworth Memorial Library in Cascade Montana for 1991 was duplicated. the second copy has the LIBNAME of Liberty County Library and the ADDRESS of that library but all other items are otherwise identical to Wedsworth.
The data for Brownsville Free Public Library, Pennsylvania, for 1990 was duplicated and this duplication is continued through PLDF2. It is FSCSKEY PA0001.