On July 27, 2021, the SEC began limiting automated searches to no more than 10 requests per second no matter the number of machines used to submit requests. This measure ensures that automated searches will not affect other users’ capability to access EDGAR websites, including
EDGAR Company Database and
EDGAR Portal. As stated in the agency’s Internet Security Policy, automated tools or “unclassified” bots are not permitted to crawl agency websites. Requests that are deemed part of an automated tool or unclassified bot and exceed 10 requests per second will be managed to guarantee equal access for all users.
To limit excessive automated searches, the SEC may limit further requests from the associated IP address(es) for a short time should a user or application submit more than 10 requests per second to EDGAR websites. Users will be able to resume access to these websites once the rate of requests drops below the limit of 10 requests per second. This measure is neither intended nor expected to affect use by individuals.
The SEC does not offer technical support for developing or debugging scripted processes but does provide information and resources related to the rate control limits on its website. Refer to the agency’s Internet Security Policy and the SEC Developer Page.
Sources:
SEC to apply new rate control limits to EDGAR websites (sec.gov)
