‘It’s the largest database ever assembled in the world’

In January, Gen. Michael Hayden, then the principal deputy director of national intelligence, the federal government’s interest in American [tag]phone calls[/tag] was “targeted” and “focused” on the [tag]al Qaeda[/tag] terrorist network. As it turns out, there’s a little more to it than that.

The [tag]National Security Agency[/tag] has been secretly collecting the phone call records of tens of millions of Americans, using data provided by AT&T, Verizon and BellSouth, people with direct knowledge of the arrangement told USA TODAY.

The [tag]NSA[/tag] program reaches into homes and businesses across the nation by amassing information about the calls of ordinary Americans — most of whom aren’t suspected of any crime. This program does not involve the NSA listening to or recording conversations. But the spy agency is using the data to analyze calling patterns in an effort to detect [tag]terrorist[/tag] activity, sources said in separate interviews.

“It’s the largest [tag]database[/tag] ever assembled in the world,” said one person, who, like the others who agreed to talk about the NSA’s activities, declined to be identified by name or affiliation. The agency’s goal is “to create a database of every call ever made” within the nation’s borders, this person added.

For the customers of these companies, it means that the government has detailed records of calls they made — across town or across the country — to family members, co-workers, business contacts and others.

Just to be clear, the NSA is not listening to all of our phone calls (foreign and domestic); it’s just logging them into a massive database.

Dana Perino, deputy [tag]White House[/tag] press secretary, said that all intelligence activities undertaken by the federal government “are lawful, necessary and required for the pursuit of al-Qaeda and affiliated terrorists.” So, when you call Grandma, and the NSA enters that call into its records, it’s “necessary.”

USA Today ran a handy Q &A on this, including the two most obvious questions.

Q: Why did they do this?

A: The agency won’t say officially. But sources say it was a way to identify, and monitor, people suspected of terrorist activities.

Q: But I’m not calling terrorists. Why do they need my calls?

A: By cross-checking a vast database of phone calling records, NSA experts can try to pick out patterns that help identify people involved in terrorism.

And the Bush administration has proven itself to be trustworthy, and not all prone to abusing its power, so there’s obviously no reason to worry about a secretive agency logging every American call for secret reasons. What’s not to like?

By the way, after 9/11, AT&T, Verizon, and BellSouth all agreed to give the NSA what it wanted for this program — but Qwest didn’t.

Trying to put pressure on Qwest, NSA representatives pointedly told Qwest that it was the lone holdout among the big telecommunications companies. It also tried appealing to Qwest’s patriotic side: In one meeting, an NSA representative suggested that Qwest’s refusal to contribute to the database could compromise national security, one person recalled.

In addition, the agency suggested that Qwest’s foot-dragging might affect its ability to get future classified work with the government. Like other big telecommunications companies, Qwest already had classified contracts and hoped to get more.

Unable to get comfortable with what NSA was proposing, Qwest’s lawyers asked NSA to take its proposal to the FISA court. According to the sources, the agency refused.

The NSA’s explanation did little to satisfy Qwest’s lawyers. “They told (Qwest) they didn’t want to do that because [tag]FISA[/tag] might not agree with them,” one person recalled. For similar reasons, this person said, NSA rejected Qwest’s suggestion of getting a letter of authorization from the U.S. attorney general’s office.

Good for Qwest. It would have been easy to cave to heavy-handed pressure from the administration, but Qwest wanted assurances. At least one company did.

i’m glad i have qwest.

  • The real joy of this is they are using this data to create tips to give to the FBI, and probably getting a hit rate of less than one percent. No wonder they don’t want to take this to the Foreign Intelligence Surveillance Court (FISC). The FISC won’t even consider giving a warrant if the chances of getting intelligence is less than one percent, and without a warrant the surveillance is unconstitutional.

    I suspect the NSA is getting tired of hearing that.

    This is like the game “Seven degrees of Seperation from Kevin Bacon”. You may have never called overseas to a known terrorist telephone number, but what if you call their favorite restaurant? Are you going to be watched now?

  • The only thing that surprises me is the claim they are merely logging and notrecording.

    I expect that claim is false.
    I expect they are recording as well.

    One should ALWAYS expect the worst of this administration.

    If you haven’t learned to do that you haven’t been paying attention for quite some time.

    The malfeasance and mendacity oozing to the surface here, are but a few cells torn from a vast, raging, and hidden cancer….

    To paraphrase and old J. B. Haldane quote:

    The Bush administration is not only more evil than we imagine, it is more evil than we can imagine.

  • Traffic analysis (now subsumed into data mining) can tell you a lot about who’s who and what they are doing based on who they call without knowing the actual contents of the call. Would you feel comfortable about the existence of this database if you were active in the antiwar movement?

  • The public’s probably half-way comfortable with the NSA “terrorist surveillance” by now, so why not push the envelope a little further? The government logs all domestic calls, then a year later it will be announced they needed to put names and addresses with those calls. Then they’ll announce they’ve been logging spending habits based on credit card transactions. They chip away a little at the Bill of Rights, wait for the public to become comfortable, then push it a bit further.

    Of course, USA Today has just reminded the terrorists that the U.S. government is looking for them. Traitors. And now we know Qwest is objectively pro-terrorist. Why does that company hate America and our freedom?

    Remind me again, why isn’t censure and impeachment of Bush and Cheney a good idea right now?

  • I have Working Assets as my long distance carrier. I can only assume they would NOT cooperate. They are not a major carrier, so they did not warrant (no pun intended) mentioning in the article.

    I emailed them for clarification on their policy.

    I did the same for Comcast who provides my local cable phone service and my high-speed internet connection.

    I’ll follow-up with their responses.

    I would like to suggest that we put the free-market to work. Encourage anyone with service form a cooperating carrier to switch.

  • prm – according to my wingnut brother-in-law, it’s because we are “in a time of war.”
    After all, we have to make SOME sacrifices.

  • I have never been a big fan of Qwest. This comes from being their customer for years and dealing with their customer service. However, I believe they have just moved from the $h!t list to the hit list. Good for Qwest.

    The obvious bad news is that the liberal lawyers have obviously infultrated the corporate world and are trying to impress their radical agenda on American business.

    This is a special message for the NSA who may be logging but not necessarily reading this post:
    Jihad! Jihad! Osama Bin Laden. Al Queda. The meeting with “dark monkey” at “location Alpha” is set for Zero hour -10days. Power to the people!

  • So with a call, someone can find out who reporter X or politician Y has been talking to.
    I think when all the dust clears, which might be years, this whole non-sense is going to boil down to political ham-stringing.
    And I wouldn’t be surprised if they aren’t selling this info to corps who would love to know your calling and emailing habits.

  • “The only thing that surprises me is the claim they are merely logging and notrecording.

    I expect that claim is false.
    I expect they are recording as well.” – koreyel

    Recording takes up much more bytes than just logging calls placed and received. Further, they don’t have the manpower to listen in real time to known terrorist communications (how the NSA failed us on 9/11). They certainly don’t have the manpower to listen in to 300,000,000+ people’s phone conversations.

    Now, if they get suspicious of you because you called a Middle Eastern restuarant, then they might listen into your phone calls. I think I need to point this out to my wife, who loves to eat Middle Eastern cusine but comments on LGF.

  • The article has a sidebar in which Specter and Leahy respond to the revealations. Does anyone want to guess what Specter’s response was? Answer:

    Sen. Arlen Specter, R-Pa., the chairman of the Senate Judiciary Committee, said he would call the phone companies to appear before the panel ”to find out exactly what is going on.”

    That’s right Specter wants another hearing, becuase all of his other hearings on this issue have worked out so well. Specter is my Senator. He has lost me completely.

  • I think I need to point this out to my wife

    If you call her on the phone to let her know, be sure to say “hi” to the two guys sitting in the florist van around the corner…

  • I thought I was going to bust a vein this morning after reading the USA Today article. Good thing I’m at work — I’m waiting until I get home to call Verizon, and if I called them an hour ago, I probably would have said things that would cause the men in dark glasses to show up at my door.

    I will be telling them 1) I want a copy of the court order that justifies the violation of my privacy rights under Section 222 of the 1934 Telecom Act; 2) failing that, I want a refund of my bills since the beginning of the program — let the NSA pay them; 3) I am actively searching for an alternate local phone service provider who is not tainted by illegal cooperation with the NSA; and 4) I am actively seeking redress through legal means, such as a class-action lawsuit.

  • Working Assets buys unused capacity from Sprint.

    That would include their switches, etc.

    So Working Assets isn’t in the clear.

  • Go Farmgirl!!!

    I am really impressed that USA Today, which is hardly a liberal publication, is taking the lead on this. Hopefully this will give a green light to the rest of the Gannett chain to step up and do their job informing the public. This could make a huge difference by pulling around 100 daily papers into the conversation. Anyway, I have my fingers crossed on this one.

    The time that the story was released (11:06 ET) is sure to catch administration flacks off guard and flat-footed. Watching the shills try to spin their way out of this is going to have an initial high entertainment factor. I think my day would be made if Hannity, O’Reilly, or Limbaugh had a meltdown while they’re live on the air this afternoon.

    Looking at this from my semi-luddite perspective, if I was a terrorist I would buy a roll of stamps.

  • I have never been a big fan of Qwest. This comes from being their customer for years and dealing with their customer service. However, I believe they have just moved from the $h!t list to the hit list. Good for Qwest.

    Haha, me too. I never thought I’d see the day I would be happy to be a Qwest customer. But what do you know?

    Good for Qwest.

  • Just to be clear, the NSA is not listening to all of our phone calls (foreign and domestic); it’s just logging them into a massive database.

    Actually, we don’t know what the NSA is listening to. We do know that it is currently impossible for them to record **all** of the phone calls in the US, but their data taps (as reported in the EFF lawsuit) let them monitor all data and voice calls in the US, they are only limited by technology in the number they can tap simultaneously.

    We can assume that the result of data mining this national database of calls is used to justify taps on calls and probably includes domestic calls.

    It is laughable that even a Republican would have to ask the phone companies what the Bush administration is doing since the Administration won’t be honest with the American people.

  • Given that they are collecting every phone call made, I have to assume that the NSA is going all the way and collecting a database of every e-mail sent as well. Maybe not the details of every e-mail (though that would be easier to do than recording phone conversations), but at least who is sending and who is receiving e-mail.

    Our government has run amuck much too long on this “war on terror”. I’m sorry but you cannot fight a war against a strategy. 9/11 was a horrible tragedy, however it was an isolated, un-duplicatable event. If the admin really wants to use technology to combat ‘the enemy’, why don’t we fix Iraq’s telecommunication infrastructure and monitor calls in Iraq??

  • “The only thing that surprises me is the claim they are merely logging and notrecording.

    I expect that claim is false.
    I expect they are recording as well.”
    koreyel

    There are approximately 190,000,000 phone lines in the U.S. This doesn’t include cell phones or VOIP lines, just plain old telephone service.

    I read somewhere that average line use is about 1 hour per day, so that means 95,000,000 hours of conversation per day, assuming that almost all calls are between 2 people.

    When choosing compression methods/amounts you have to decide if you just want to be able to understand clearly spoken conversation, or if you want to be able to identify voices, hear background sounds, etc.

    At the high end your looking at maybe 1,000,000 bytes per minute, at the low end you might be able to get away with 10,000 bytes per minute.

    So at the low end you’re looking at perhaps 57,000,000,000,000 bytes per day. With a bit of rounding and estimating were talking about over 50 Terabytes per day, just to catch carefully/clearly-spoken conversations and nothing more. 5,000 Terabytes per day to catch details such as background sounds.

    Compare this to the requirements if all you are going to store is the connection information:

    A pair of phone numbers can be stored in about 9 bytes.

    If we assume that there is no interest in storing information beyond 10 years, then the date and time that the connection was made can be stored in another 4 bytes. Furthermore, if we are willing to lump all calls that exceed 18 hours together, then we can store the duration of the connection in another 2 bytes.

    All together we’re looking at 15 bytes per call at most. With some compression you might be able to get this closer to 8 bytes per call.

    I don’t have any statistics on number of calls placed per day, so I’m going to assume the average call length is about 1 minute (if you have statistics on this feel free to correct my math). With 95,000,000 hours of conversation and an average duration of 1 minute I get 5,700,000,000 connections per day.

    That works out to about 45,600,000,000 bytes (a little under 45 Gigabytes) per day on the low end, and at most 85,500,000,000 bytes (a little under 85 Gigabytes) per day to store who called who at what time and for how long.

    Since the connection information is all numbers I suspect that some pretty sophisticated computer programs could be written to analyze this data to find a lot of very useful information.

    So it doesn’t surprise me at all that they would be trying to gather and analyze this information (I don’t agree with it, but it doesn’t surprise me).

    Personally I just don’t believe that the processing power exists yet to analyze and filter audio recordings of the magnitude we’re looking at here.

    Of course, if they could do it, I have no doubt they would, I just don’t think it’s realistic yet.

  • Do you REALLY think that it’s impossible for the NSA to be recording all phone calls? Hell, by a few decades back, they had banks of computers recording and sifting through every international phone call. Think of the advances in technology. Are they actually recording every phone call for posterity, in its entirety? Probably not, but not for lack of capability. The only reason that they don’t is that it’s a lot harder to sift through a whole pile of crap to find things.

    But… on the other hand, with a halfway decent speech patttern recognizer, they could log the basic contents of most phone calls with a small number of words- think ‘grocery,soccer practice, blow up something…’. That system, I assure you, is solidly in place, and outside of the telcos anyway.

    What the information from the telcos allows them to do is add more data tags to their already-recorded phone calls, making the database searches much more relevant. So, where before they had to go to a second source to look up the name attached to a random phone number and call, now the system automatically tags both the sending and receiving parties, allowing searches made on the database to bring up connected parties as well as cell phone numbers.

    All in all, the ‘revelation’ isn’t that much of a deal. We already knew that the NSA, in this digital age where calls are routed through satellites and god knows where, was inevitably collecting data on local calls. This is merely an administrative piece being opened up.

  • Oh, yeah, and one more thing. For anyone who doubts the feasability of this- please remember that the NSA already admits to temporarily recording all international phone calls (for storage reasons, as attempting math notes, they only permanently keep the voice records for calls which trigger the additional analysis levels). The extension to include temporarily recording all U.S. calls is merely a scaling issue- and a few million here or there is certainly not going to break NSA’s budget.

  • This is just too funny—so I called a friend, and we chatted for a while about writing a cookbook: “!,001 Ways to Cook and Serve a Tainted President.” We discussed “Graft Au Gratin,” “Wiretapping w/ White Wine Sauce,” and a “Little Lord Fauntleroy Luau” (in which we shove an apple into the idiot’s mouth and serve him with poi and toast).

    So now I’ll just wait for Hayden’s Hordes to show up at my door….

  • I’m almost tempted to overlook Qwest’s crappy service and their tendency for pocketing taxes collected in the name of governments and switch to them.

    Almost.

  • “So now I’ll just wait for Hayden’s Hordes to show up at my door….” – Steve

    As far as we know right now, Hayden is borrowing his foot soldiers from the FBI. Still, who knows what will happen in the future.

  • Let’s remember that this may still be the tip of the iceberg. Bush, Rumsfeld, Cheney, Gonzalez, Ashcroft, etc., have, time and time again, shown us that they really, really, REALLY want to eavesdrop on as many people as they can — and that nothing will deter them. (Remember Admiral Poindexter and his Total Information Awareness program, and the subsequent Congessional outcry? It seems almost quaint now.)

    If the NSA is doing all this, I can barely begin to imagine what the Pentagon must be up to.

  • I recently got vonage. I then heard that it is nearly impossible for the NSA to monitor those calls because they are internet oiginated. Does anyone know if that is true?

  • Re: #26

    I very strongly doubt that “because they are Internet-originated” will in any way guarantee you greater security. In fact, because it is the Internet, I’m inclined to believe that eavesdropping would be easier.

    But I don’t know how Internet telephony works. There could be other security methods but if anyone is going to be able to defeat them or even bypass them through a backdoor it will be the government.

    Additionally, they currently are spying on Internet traffic right now. I did a search for previous CB stories and astonishingly, I can find none! Slashdot has covered this:

    http://yro.slashdot.org/article.pl?sid=06/04/07/1246259

    http://yro.slashdot.org/article.pl?sid=06/04/13/1218237

    http://yro.slashdot.org/article.pl?sid=06/04/29/040225

    More information at http://www.eff.org as well.

    It’s being done at AT&T and I don’t see why this wouldn’t also be the case with every other major Internet provider except maybe Qwest.

  • lost in all the chatter about the nsa program is the type of program it is: signals intelligence.

    think of it this way. during a war, an enemy base has a regular population, exchanges a certain amount of routine phone and radio traffic each week, and receives a regular amount of supplies. then one day, the communication traffic increases dramatically. more and different supplies are sent in. the bases recieves more men. You don’t have to know the specifics of the phone traffic to realize that something is up, and from the other signals it might be an imminent attack, or,if you were planning to attack the base yourself, that they are planning to defend–and must have broken your codes are interpreted your own signals to reach this conclusion.

    a modern day example is a cop reading a speed gun. he doesn’t stare at the flickering numbers all afternoon. he’d go crazy. the numbers won’t vary much. 45, 46, 44, 49, 43. he’d wait until the number leaps suddenly, so to 51. now he pays attention because the leap is out of the ordinary and possibly a speeder.

    now let’s apply this to daily life. say you call your church three times a week in the course of your volunteer duties. then because of additional volunteer duties for a special event outside the usual holiday schedule, you start calling that phone number ten times a week. the phone traffic is increased between the church and other parishoners too, as well as between you and those others. this is the type of anomoly that draws notice, especially, if, say, your church has been involved in protests. now the nsa would take a longer look at the church. what’s going to happen? what are you planning? you and it and your fellow parishioners would become people of interest, even if all you were doing was coordinating was a rummage sale to help katrina victims.

    that’s the real danger here. not what you say on the phone., but what they think you might be saying and to whom you might be saying it to based on a change in social patterns.

  • How is all this going to catch a guy hiding in a cave in Pakistan? Or what if the next terrorist is another homegrown Tim McVeigh and these guys are looking for Muslims?

    It’s all too much money, technology and energy being spent for no good that’s open to too much mischief. For every Maginot line that gets built there’s someone who simply notes “we’ll just go around it.” Why keep building such high tech defenses when terror can be achieved with such low tech devices. The might U.S.S. Cole, with all its high tech weapons systems and detections capabilities was almost sunk by a rubber dinghy. Al Quaeda can be defeated by some simple human intelligence and if only we weren’t so busy pissing off the rest world, maybe people would be willing to help us.

  • I want to know who’s going to sort through all those endless cell phone calls between teenage girls (which must account for the half the phone traffic in this country) or the endless silences between these girls and their teenage boyfriends as they listen to each other breathing.

    No wonder phone bills are so high – someone has to pay for all this technology and the personnel to operate it and the surveillance time.

  • If you believe that all these calls are merely being logged, and not listened to, I have some swamp land I’d like to sell you.

  • Comments are closed.