In this article, we give an overview of our Co-ops & Contracts dataset.
Dataset Description
The Co-ops & Contracts module encompasses contractual agreements between private vendors and public institutions for the procurement of goods, services, and rendered work. While inherent constraints in disclosure impede our ability to achieve comprehensive coverage, it is worth noting that GovSpend stands as the most exhaustive service available in the market for accessing this critical information.
Data Sources/Collection Methods
Contracts are meticulously acquired through various channels, including direct procurement from public agencies via public records requests, automated web scraping from publicly accessible websites, and, specifically for Federal Contracts, sourced from <Federal Source>. Leveraging our expertise in state-level public records laws, we engage with a network of FOIA coordinators, custodians of records, superintendents for schools, PRR Officers, legal counsel, and other designated agency personnel to obtain pertinent data.
It is imperative to recognize the intricacies involved in the FOIA/PRR process, compounded by the diverse regulatory frameworks and legal precedents that govern agencies. Furthermore, the scarcity of publicly available resources underscores the need for meticulous review and potential redaction, with legal considerations, such as the protection of trade secrets, guiding these measures. It is paramount to acknowledge that agencies retain the prerogative to deny PRR/FOIA requests on various grounds, underscoring the complexity inherent in accessing certain datasets.
It is essential to note that despite our best efforts, limitations may arise due to agency delays, redactions, or reluctance to fulfill requests. Additionally, certain Co-Ops may prohibit the exposure of their agreements to competitors, necessitating discretion in data dissemination.
Refresh Rates/Timeliness
Data refreshment occurs through daily scraper runs targeting transparency sites and other public domains to capture new contracts promptly.
Dataset Trends
An inherent characteristic of this dataset is the cyclic pattern observed in contract data, with monthly fluctuations attributed to contract renewals and expirations. Expect an increase in contract filings towards the end of each month. As our coverage continues to expand through the integration of new scrapers, efforts are underway to develop tools facilitating comparative analysis to enhance data comprehension.
Coverage Highlights:
- 3 million+ combined Contracts
- 500,000+ Active Contracts (SLED and Federal)
- 630,000+ Federal Contracts
- 30+ Cooperative Providers