Recent from talks
Nothing was collected or created yet.
Boundless Informant
View on WikipediaNational Security Agency surveillance |
|---|
Boundless Informant (stylized as BOUNDLESSINFORMANT) is a big data analysis and data visualization tool used by the United States National Security Agency (NSA). It gives NSA managers summaries of the NSA's worldwide data collection activities by counting metadata.[1] The existence of this tool was disclosed by documents leaked by Edward Snowden, who worked at the NSA for the defense contractor Booz Allen Hamilton.[2] Those disclosed documents were in a direct contradiction to the NSA's assurance to United States Congress that it does not collect any type of data on millions of Americans.[3]
History
[edit]Intelligence gathered by the United States government inside the United States or specifically targeting US citizens is legally required to be gathered in compliance with the Foreign Intelligence Surveillance Act of 1978 (FISA) and under the authority of the Foreign Intelligence Surveillance Court (FISA court).[4][5][6]
NSA global data mining projects have existed for decades, but recent programs of intelligence gathering and analysis that include data gathered from inside the United States such as PRISM were enabled by changes to US surveillance law introduced under President Bush and renewed under President Obama in December 2012.[7]
Boundless Informant was first publicly revealed on June 8, 2013, after classified documents about the program were leaked to The Guardian.[1][8] This report contained a Top Secret heat map produced by the Boundless Informant program summarizing data records from 504 separate DNR and DNI collection sources or SIGADs. In the map, countries that are under surveillance are assigned a color from green to red (which does not correspond to intensity of surveillance).[9]

As this map shows that almost 3 billion data elements from inside the United States were captured by the NSA over a 30-day period ending in March 2013, Snowden stated that this tool was collecting more information on Americans located within the United States than on Russians in Russia.[10] Snowden stated that he had raised concerns about this with his superiors at the NSA beginning in October 2012, specifically with two superiors in the Hawaii regional base of the NSA Threat Operations Center and two superiors in the Technology Directorate of the NSA. Snowden states that he brought up these concerns through the Dissent Channel.[10]
Snowden added that coworkers often were "astonished to learn" about this detail and did not wish to know any more about the program, and that until April 2012 he often asked these colleagues "What do you think the public would do if this was on the front page?"[10] Vanee Vines, an NSA spokesperson, stated that "After extensive investigation, including interviews with his former NSA supervisors and co-workers, we have not found any evidence to support Mr. Snowden's contention that he brought these matters to anyone's attention."[10]
The first publication about Boundless Informant was followed by screenshots from this program showing charts with details about the data that NSA allegedly collected from several European countries between December 10, 2012 and January 8, 2013. These charts were published by a major news outlet from each of these countries:

- July 29, 2013: Germany: a big chart about this country, showing more than 552 million telephony and internet data, alongside four smaller charts about the Netherlands, France, Spain and Italy were published by the magazine Der Spiegel.[11]
- October 20, 2013: France: a chart showing almost 70 million telephony metadata was published by the newspaper Le Monde.
- October 28, 2013: Spain: a chart showing 60 million telephony metadata was published by the newspaper El Mundo.[12]
- November 19, 2013: Norway: a chart showing 33 million telephony metadata was published by the tabloid paper Dagbladet.[13]
- December 6, 2013: Italy: a chart showing almost 46 million telephony metadata was published by the tabloid paper L'Espresso.[14]
- February 8, 2014: Netherlands: a chart showing 1.8 million telephony metadata was published by the newspaper NRC Handelsblad.[15]
Initially, these media wrote that the BoundlessInformant charts showed how many phone calls the NSA intercepted from a particular country. A first correction of this interpretation is that the program doesn't count the content of phone calls, but only the metadata thereof (see below).
A second correction is about by whom and where these data were collected. On August 5, a week after the publication of a chart from BoundlessInformant in Germany, the German intelligence agency (BND) said that they collected these data from foreign communications, related to military operations abroad.[16][17] A similar statement was made by the Norwegian Intelligence Service, after a chart about Norway was published on November 19.[18] On February 4, 2014, the Dutch government revealed that the 1.8 million metadata in the chart about the Netherlands were not collected by NSA, but instead by the Dutch Military Intelligence and Security Service (MIVD), also to support military operations, which almost led to the resignation of the Dutch interior minister.[19]
On October 29, 2013, NSA-director Keith B. Alexander declared that accusations in French, Spanish and Italian media about NSA intercepting millions of phone calls from these countries are "completely false". He added that "This is not information that we collected on European citizens. It represents information that we and our NATO allies have collected in defense of our countries and in support of military operations."[20]
Technology
[edit]Although the initial reports in European media stated that the various charts presented the numbers of phone calls intercepted by NSA, a PowerPoint presentation and a FAQ document published by The Guardian[21] say that BoundlessInformant is counting and analysing DNI (internet) and DNR (telephony) metadata records passing through the NSA's signals intelligence systems, and are therefore not showing how much content of internet and telephone communications is intercepted.[22]
Data analyzed by Boundless Informant includes electronic surveillance program records and telephone call metadata records stored in an NSA data archive called GM-PLACE. It does not include FISA data, according to the FAQ memo. PRISM, a government codename for a collection effort known officially as US-984XN, which was revealed at the same time as Boundless Informant, is one source of DNR data.[9]
According to published slides, Boundless Informant leverages Free and Open Source Software—and is therefore "available to all NSA developers"—and corporate services hosted in the cloud. The tool uses HDFS, MapReduce, and Accumulo (formerly Cloudbase)[23] for data processing.[24]
See also
[edit]References
[edit]- ^ a b Glenn Greenwald and Ewen MacAskill (June 8, 2013). "Boundless Informant: the NSA's secret tool to track global surveillance data". The Guardian. London. Retrieved June 12, 2013.
- ^ Greenwald, Glenn; MacAskill, Ewen; Poitras, Laura (June 9, 2013). "Edward Snowden: the whistleblower behind revelations of NSA surveillance". The Guardian. London. Retrieved June 9, 2013.
- ^ "Here's The NSA's Supposedly Non-Existent Tool To Track Global Metadata". Gawker. June 9, 2013. Archived from the original on March 20, 2014. Retrieved March 20, 2014.
- ^ Dean, John W. George W. Bush as the New Richard M. Nixon: Both Wiretapped Illegally, and Impeachable; Both Claimed That a President May Violate Congress' Laws to Protect National Security, FindLaw, December 30, 2005
- ^ The Impeachment of George W. Bush Archived March 18, 2006, at the Wayback Machine by Elizabeth Holtzman, The Nation, January 11, 2006
- ^ Adopted By The House Of Delegates Archived March 26, 2009, at the Wayback Machine (Archive), American Bar Association, February 13, 2006
- ^ Greenwald, Glenn (June 6, 2013). "NSA taps in to internet giants' systems to mine user data, secret files reveal". The Guardian. London. Retrieved June 6, 2013.
- ^ "Boundless Informant | World news". The Guardian. London. June 8, 2013. Retrieved June 9, 2013.
- ^ a b "Boundless Informant NSA data-mining tool – four key slides". The Guardian. London. June 8, 2013. Retrieved June 9, 2013.
- ^ a b c d Gellman, Barton. "Edward Snowden, after months of NSA revelations, says his mission’s accomplished." The Washington Post. December 23, 2013. Retrieved on February 7, 2014.
- ^ Daten aus Deutschland, August 5, 2013
- ^ Glenn Greenwald & German Aranda, La NSA espió 60 millones de llamadas en España en sólo un mes, October 28, 2013
- ^ Glenn Greenwald & Arne Halvorsen, USA overvåket 33 millioner norske mobilsamtaler, November 19, 2013
- ^ Glenn Greenwald & Stefania Maurizi, Da qui ci spiano gli americani, December 6, 2013.
- ^ "Dutch government tried to hide the truth about metadata collection". Electrospaces.net. February 17, 2014. Archived from the original on December 3, 2019. Retrieved July 5, 2024.
- ^ Gude, Hubert; Poitras, Laura; Rosenbach, Marcel (August 5, 2013). "German Intelligence Sends Massive Amounts of Data to the NSA". Der Spiegel. ISSN 2195-1349. Archived from the original on July 11, 2023. Retrieved July 5, 2024.
- ^ Marcel Rosenbach & Holger Stark, Der NSA Komplex, Deutsche Verlags-Anstalt, München 2014, p. 235 and 326.
- ^ Greenwald, Glenn (November 22, 2013). "NSA-files repeatedly show collection of data «against countries» - not «from»". dagbladet.no (in Norwegian). Retrieved April 28, 2021.
- ^ Top Level Telecommunications, Dutch government tried to hide the truth about metadata collection, February 17, 2014
- ^ Reuters.com, NSA chief defends agency amid U.S. spy rift with Europe Archived September 24, 2015, at the Wayback Machine, October 29, 2013
- ^ "Boundless Informant: NSA explainer – full document text". The Guardian. London. June 8, 2013. Retrieved June 12, 2013.
- ^ Top Level Telecommunications, BOUNDLESSINFORMANT only shows metadata, October 22, 2013.
- ^ "NSA Mimics Google, Pisses Off Senate, Cade Metz". Wired. July 17, 2012.
- ^ "Boundless Informant slides". Documentcloud.org. Retrieved June 9, 2013.
External links
[edit]Boundless Informant
View on GrokipediaOverview
Core Purpose and Capabilities
Boundless Informant, internally designated as US-984XN, serves as the National Security Agency's (NSA) primary system for quantifying and mapping signals intelligence (SIGINT) collection volumes across global networks.[1] Its core purpose is to enable NSA analysts to track the origin, scale, and distribution of intercepted communications metadata, facilitating oversight of data ingestion from various surveillance programs without delving into message contents.[1] This tool aggregates statistics on telephony and internet metadata, categorized by collection methods such as digital network intelligence (DNI), to answer queries like "What assets collect against a specific country?"[11] The system's capabilities include generating interactive visualizations, such as world maps color-coded by data volume per country, allowing users to drill down into specifics like the number of records from upstream or foreign partners.[8] For instance, it reported nearly 3 billion intelligence records from U.S. computer networks over a 30-day period in 2013, with breakdowns by selector types and geographic targets.[1] Boundless Informant supports pattern recognition for resource allocation, identifying high-yield collection points rather than performing direct content analysis, and integrates data from programs like PRISM to provide a holistic view of NSA's global datamining footprint.[3] Leaked documents indicate the tool's emphasis on metadata—such as call records, IP addresses, and email headers—enables compliance monitoring and operational efficiency, though it has drawn scrutiny for revealing extensive collection against allies and domestic networks.[4] Capabilities extend to customizable reporting, where analysts can filter by time frames, collection disciplines, or third-party contributions, ensuring the NSA maintains granular accountability over its vast SIGINT enterprise.[12]Integration with NSA Surveillance Ecosystem
Boundless Informant functions as a centralized analytics platform within the NSA's signals intelligence (SIGINT) framework, aggregating and visualizing metadata from multiple upstream collection programs to provide operational oversight of global data intake.[1] It processes records from electronic surveillance and telephone metadata stored in the agency's primary data archives, enabling analysts to quantify collection volumes by source, geography, and type without accessing content.[1] This integration supports resource allocation and compliance monitoring across disparate tools, such as PRISM for corporate data feeds and Upstream for internet backbone taps.[13] The tool interfaces with NSA's broader ecosystem by ingesting data tagged with SIGAD identifiers—unique codes for collection sites or programs—allowing users to drill down into contributions from specific initiatives, including foreign partner shares under the Five Eyes alliance.[8] For instance, it categorizes inbound records as either DNI (Direct from National Intelligence) or FNR (Foreign National something, per slides), reflecting direct NSA taps versus partner-provided intelligence, thus revealing the distributed nature of the surveillance network.[8] Visualization features, including interactive heat maps, display per-country metadata volumes—such as 97 billion records processed in a 30-day period ending March 2013—facilitating assessments of collection efficacy against targets.[1] Boundless Informant's architecture complements query and analysis systems like XKeyscore by focusing on aggregate metrics rather than individual searches, serving as a meta-layer for auditing the scale and distribution of surveillance yields from integrated feeds.[14] This setup allows NSA leadership to evaluate program performance, as evidenced by internal slides showing breakdowns by communication type (e.g., email, facsimile) and origin, ensuring alignment with mission priorities amid exponential data growth.[8] While enhancing internal efficiency, the tool's exposure of incidental U.S. person data volumes—estimated at three billion in the same period—highlighted tensions between foreign intelligence mandates and domestic minimization rules.[1]Development and History
Origins and Early Implementation
Boundless Informant was developed by the U.S. National Security Agency (NSA) as a classified tool to record, analyze, and visualize the scope of its global signals intelligence collection, primarily focusing on metadata rather than content.[1] The system enabled NSA managers to generate summaries of data volumes by country, selector type, and collection method, providing near real-time insights into surveillance coverage.[1] Leaked documents indicate operational use by at least September 2012, as evidenced by training slides titled "Boundless Informant: Describing Mission Capabilities from Metadata Records," which outlined its role in aggregating and categorizing intelligence records from NSA sources.[15] Early implementation integrated Boundless Informant with the NSA's broader metadata ingestion pipelines, allowing automated tracking of records from programs like upstream collection under Section 702 of the FISA Amendments Act and other foreign intelligence authorities.[1] The tool produced outputs such as interactive heat maps and statistical reports, facilitating oversight of collection efficiency and compliance with internal limits, though it did not perform content analysis.[1] By March 8, 2013, a documented snapshot revealed the system had logged 97 billion pieces of intelligence worldwide over the prior 30 days, including 3 billion from domestic U.S. networks, underscoring its scale in early operational phases.[1] [4] Initial enhancements focused on user-requested features, such as improved query capabilities and integration with other NSA databases, to address gaps in visualizing complex data flows.[1] This foundational setup positioned Boundless Informant as a key component in the NSA's post-9/11 expansion of metadata-driven intelligence management, though specific development timelines remain classified beyond the leaked materials.[1]Evolution Through 2013
Boundless Informant emerged as an operational tool within the National Security Agency (NSA) by mid-2012, enabling managers to obtain summaries of global data collection activities through metadata record counts. Training materials dated July 13, 2012, outlined its mission capabilities, demonstrating its use in analyzing metadata to assess surveillance volumes and sources.[16] By September 6, 2012, an internal frequently asked questions document described the system as a "work-in-progress" datamining tool designed to provide near real-time visibility into intelligence origins, categorized by country, selector types, and collection methods.[17] The tool's capabilities expanded to include advanced visualization features, such as interactive heat maps depicting data volumes across geographic regions. In March 2013, Boundless Informant generated a global snapshot revealing 97 billion pieces of intelligence collected over a 30-day period, with significant portions from countries including Iran (14 billion records) and Pakistan (13.5 billion records).[1] This reflected its role in quantifying metadata from diverse signals intelligence sources, excluding content interception.[1] Ongoing enhancements were managed through a triage process for user requests, classified by implementation difficulty (easy, medium, hard) and mission impact (high, medium, low), underscoring iterative development to handle escalating data ingestion demands.[1] By early 2013, it supported detailed breakdowns, such as nearly 3 billion pieces from U.S. computer networks in one month, aiding internal oversight of collection efficacy without revealing operational specifics.[1]Technical Architecture
Data Ingestion and Analysis Mechanisms
Boundless Informant ingests data by systematically extracting metadata from every valid DNI (internet metadata, such as email or web activity records) and DNR (telephony metadata, such as call detail records) passing through the National Security Agency's (NSA) signals intelligence (SIGINT) infrastructure.[18] This process captures records from diverse sources, including upstream collection under programs like FAIRVIEW and STORMBREW, foreign partner contributions via the Five Eyes alliance, and targeted selectors under Foreign Intelligence Surveillance Act (FISA) authorities or Executive Order 12333.[1] The ingestion focuses exclusively on metadata volumes rather than content, enabling aggregation across petabyte-scale datasets without storing full communications.[1] Once ingested, the system processes metadata through aggregation mechanisms that compile counts over user-selectable periods, such as 7 or 30 days, to produce near real-time snapshots of global access operations (GAO) capabilities.[18] Analysis categorizes records by signals intelligence activity designators (SIGADs), which identify specific collection programs or partners, and sorts totals into aggregate, DNI-only, or DNR-only views for comparative assessment.[19] For instance, in March 2013, it quantified 97 billion metadata records worldwide, with breakdowns revealing high volumes from hotspots like Iran (14 billion records) and Pakistan (13.5 billion).[1] The tool's analysis features emphasize quantitative oversight, generating drill-down capabilities from high-level metrics to granular SIGAD contributions and trend lines.[19] Organizational views allow NSA managers to evaluate performance by division or mission, while map-based interfaces overlay heat maps correlating collection intensity (green for low, red for high) with geographic targets.[1][19] These mechanisms support pattern recognition for resource allocation, such as identifying underutilized selectors or escalating coverage requests, but rely on predefined filters to exclude certain domestic or allied data per policy rules.[3] Training materials underscore its role in deriving "mission capabilities" directly from metadata flows, aiding compliance monitoring and operational planning.[20]Visualization and Reporting Features
Boundless Informant provided National Security Agency (NSA) analysts with an interactive dashboard featuring a global heat map that visualized the volume of signals intelligence (SIGINT) metadata collected across countries.[1] The heat map employed a color-coded scheme ranging from green for minimal surveillance to black or red for high-volume collection, enabling quick assessment of data intake intensity by geographic region.[1] Users could select specific countries on the map to access detailed breakdowns, including total metadata records, categorized by digital network intelligence (DNI) for internet data and dial number recognition (DNR) for telephony metadata.[21] The tool's reporting capabilities focused on aggregating and summarizing metadata counts rather than content analysis, generating customizable reports on collection volumes from various NSA access points and programs.[1] For instance, internal slides indicated that Boundless Informant tracked over 97 billion metadata records in a single month in 2010, with reports detailing contributions from specific selectors, facilities, and international partners.[4] These reports supported mission planning by quantifying data flows, such as distinguishing upstream collection from foreign partners versus direct NSA taps.[12] Visualization extended to graphical representations of trends over time and by data type, allowing analysts to correlate collection efforts with operational priorities without revealing raw data.[22] NSA training materials described Boundless Informant as deriving "mission capabilities from metadata records," emphasizing its role in providing oversight metrics for managers to evaluate global data acquisition efficiency.[20] However, the tool's country attributions relied on selector locations, which could include U.S.-based routing for foreign metadata, leading to high domestic figures that reflected transit volumes rather than targeted U.S. persons collection.[12]Data Collection Scope
Metadata Types and Sources
Boundless Informant primarily analyzes two categories of metadata: Digital Network Intelligence (DNI) records from internet communications and Dialed Number Recognition (DNR) records from telephony activities.[23] DNI metadata includes elements such as source and destination IP addresses, timestamps, email routing information, and indicators of online activity like visited URLs or packet headers, excluding message content.[1] [23] DNR metadata captures details from phone calls and related signaling, encompassing dialed numbers, call durations, international mobile subscriber identities (IMSI), and geolocation data from cell site connections.[23] [7] These metadata types are aggregated from NSA's signals intelligence (SIGINT) collection pipelines, which draw from upstream intercepts of internet backbone traffic via programs accessing undersea fiber-optic cables and domestic switches.[24] [1] Sources include partnerships with telecommunications providers under legal authorities like Foreign Intelligence Surveillance Act (FISA) warrants, as well as foreign liaison relationships that facilitate data sharing from international networks.[1] [24] For instance, telephony metadata under domestic collection stems from bulk acquisition authorized by Section 215 of the USA PATRIOT Act, while DNI records often originate from global transit points where foreign communications traverse U.S. infrastructure.[15] The tool's interface categorizes these inputs by originating country or collection site, enabling visualization of volumes without accessing raw content.[23][1]Quantified Volumes and Geographic Distribution
Boundless Informant quantified the National Security Agency's (NSA) collection of 97 billion pieces of digital network intelligence (DNI) metadata from computer networks worldwide during a 30-day period ending in March 2013.[1] This figure represents metadata records, such as connection details, rather than content of communications.[1] Of these, nearly 3 billion originated from U.S. computer networks, indicating substantial domestic collection within the tool's scope.[1] Geographically, the tool's interface displayed a color-coded world heat map, with shades from green (lowest volume) to red (highest), highlighting collection intensity by country.[1] Volumes were heaviest in regions of geopolitical priority, particularly the Middle East and South Asia.[1] The top five countries by DNI metadata volume were:| Country | DNI Metadata Records |
|---|---|
| Iran | >14 billion |
| Pakistan | 13.5 billion |
| Jordan | 12.7 billion |
| Egypt | 7.6 billion |
| India | 6.3 billion |