The e-discovery world is abuzz about the new decision by Magistrate Judge Andrew J. Peck of the Southern District of New York regarding computer-assisted coding.   The case is Moore v. Publicis Group, No. 11 Civ. 1279 (ALC) (AJP), slip op. (S.D.N.Y. Feb. 24, 2012).  This is an issue of particular interest for Judge Peck, who also wrote an article on the topic in October 2011.  While it’s an issue that goes far beyond class actions or insurance class actions, it certainly has the potential to impact such cases in a major way. 

For those who haven’t heard of it, computer-assisted coding involves the use of special software to conduct a search through electronic documents (e-mails, attachments and other electronically-stored data) to identify documents relevant to a particular lawsuit.  The way it works, as explained in the opinion, is that a more senior lawyer representing the party responding to the document request reviews a small, random sample of a subset of documents, say a few thousand documents, drawn from a massive collection of say several million potentially-relevant documents (the Moore case involved over 3 million emails, and it appears that was just the beginning).  This sample might or might not first be narrowed through key word searching.  The reviewer scores the documents for their degree of relevance to the document requests.  The software then, “trained” by the reviewer, searches through the remainder of the documents and endeavors to identify their degree of relevance.  A particular statistical confidence level is selected in using the software, say a 95% confidence rate.  Sometimes more than one round of this kind of review is needed to “train” the computer consistent with the selected confidence rate.  Experienced lawyers do the review because they are better at identifying the degree of relevance. Documents that the system determines to have a lack of relevance below a particular score selected by the parties are presumed to be irrelevant, and only the relevant documents are reviewed for privilege and produced.  The idea is that this process should achieve the objective of identifying, with a sufficient confidence rate, the relevant documents, at a substantially lower cost than the usual procedure of having junior associates or contract attorneys review documents one by one for relevance (as I did over a decade ago as a junior associate at Skadden Arps).  According to Judge Peck, statistical data shows that this new computer software, when properly “trained” by senior lawyers, is now more accurate in determining relevance than the old method of manual human review.  It also makes possible review projects where the set of electronic data is so large that it would be impossible (or the cost unfathomable) to conduct a manual review. 

What Magistrate Judge Peck’s opinion seems to suggest is that this process works best where the protocol provides the party seeking the discovery with complete access to all non-privileged documents that were reviewed by the senior reviewer, and the manner in which they were tagged (for a particular level of relevance or relevance as to a particular issue), so that the party seeking the discovery can be comfortable that the “training” of the computer system is being done fairly, and thus that the computer search that is conducted based on that “training” is appropriate.  It seems to me that another approach that might be appropriate in some cases would be to let the party seeking the discovery do the review that “trains” the computer, so they are ones that are identifying what they deem to be relevant.  First the producing party would need to do a privilege review on the random sample of documents (and probably exclude other particularly sensitive documents that do not fall within the scope of the requests), but the random sample would be only a relatively small number of documents to review for privilege, etc.  If the party seeking the discovery then reviews the non-privileged documents and “trains” the computer surely they cannot complain that it was not done properly.  There may be problems that prevent using that approach in particular cases but it strikes me as an option that is worth considering. 

It also strikes me that this kind of system could also be useful in identifying privileged documents, perhaps not to make final determinations, but for narrowing what needs to be reviewed for that purpose, particularly where a clawback order is in place.  If a computer can be trained to identify levels of relevance to a high degree of certainty it likely can be trained to identify privilege in a similar way.

Judge Peck’s decision makes a few other interesting points: 

  • Rule 26(g)(1)’s certification requirement applies only to initial disclosures, and does not require producing parties to certify that document productions are “complete.”  He also notes that in cases involving massive amounts of data no lawyer could certify that a production is “complete.”  Rather, the standard of compliance is one of proportionality under Rule 26(b)(2)(C).  This rule requires federal courts to limit discovery where “the burden or expense of the proposed discovery outweighs its likely benefit, considering the needs of the case, the amount in controversy, the parties’ resources, the importance of the issues at stake in the action, and the importance of the discovery in resolving the issues.”
  • Rule 702 and Daubert only apply to expert testimony and are inapplicable to the method used to search for documents in discovery.  Thus, the procedure followed for computer-assisted coding should not have to meet Daubert standards, but instead be a reasonable process in accordance with the proportionality rule. 

In my mind the advent of this software and the fact that it has the strong support of at least one judge on a court that handles many of our country’s most complex civil cases seems like a great development for the cause of achieving what the very first rule of civil procedure (which Judge Peck cites) calls for, that is, “the just, speedy and inexpensive determination of every action and proceeding.”  Fed. R. Civ. P. 1.  If this new technology (no doubt expensive, but that won’t last forever) can cut the cost of litigation substantially and result in more cases being resolved on the merits (rather than by settlements driven by litigation costs) that will be a very positive development for our legal system and the legal profession.  More complex cases can be tried if the parties spend less time and money on discovery.  There will be fewer jobs for recent (and not so recent) law school graduates to stare at a computer screen all day coding documents, but that is not what they thought they were going to school for anyway, and not particularly productive for our economy.

Email this postTweet this postLike this postShare this post on LinkedIn
Photo of Wystan Ackerman Wystan Ackerman

I am a partner at the law firm of Robinson+Cole in Hartford, Connecticut, USA.  My contact information is on the contact page of my blog.  I really enjoy receiving questions, comments, suggestions and even criticism from readers.  So please e-mail me if you…

I am a partner at the law firm of Robinson+Cole in Hartford, Connecticut, USA.  My contact information is on the contact page of my blog.  I really enjoy receiving questions, comments, suggestions and even criticism from readers.  So please e-mail me if you have something to say.  For those looking for my detailed law firm bio, click here.  If you want a more light-hearted and hopefully more interesting summary, read on:

People often ask about my unusual first name, Wystan.  It’s pronounced WISS-ten.  It’s not Winston.  There is no “n” in the middle.  It comes from my father’s favorite poet, W.H. (Wystan Hugh) Auden.  I’ve grown to like the fact that because my name is unusual people tend to remember it better, even if they don’t pronounce it right (and there is no need for anyone to use my last name because I’m always the only Wystan).

I grew up in Deep River, Connecticut, a small town on the west side of the Connecticut River in the south central part of the state.  I’ve always had strong interests in history, politics and baseball.  My heroes growing up were Abraham Lincoln and Wade Boggs (at that time the third baseman for the Boston Red Sox).  I think it was my early fascination with Lincoln that drove me to practice law.  I went to high school at The Williams School in New London, Connecticut, where I edited the school newspaper, played baseball, and was primarily responsible for the installation of a flag pole near the school entrance (it seemed like every other school had one but until my class raised the money and bought one at my urging, Williams had no flag pole).  As a high school senior, my interest in history and politics led me to score high enough on a test of those subjects to be chosen as one of Connecticut’s two delegates to the U.S. Senate Youth Program, which further solidified my interest in law and government.  One of my mentors at Williams was of the view that there were far too many lawyers and I should find something more useful to do, but if I really had to be a lawyer there was always room for one more.  I eventually decided to be that “one more.”  I went on to Bowdoin College, where I wrote for the Bowdoin Orient and majored in government, but took a lot of math classes because I found college math interesting and challenging.  I then went to Columbia Law School, where I was lucky enough to be selected as one of the minions who spent their time fastidiously cite-checking and Blue booking hundred-plus-page articles in the Columbia Law Review.  I also interned in the chambers of then-Judge Sonia Sotomayor when she was a relatively new judge on the Second Circuit, my only connection to someone who now has one-ninth of the last word on what constitutes the law of our land.  I graduated from Columbia in 2001, then worked at Skadden Arps in Boston before returning to Connecticut and joining Robinson+Cole, one of the largest Connecticut-based law firms.  At the end of 2008, I was elected a partner at Robinson+Cole.

I’ve worked on class actions since the start of my career at Skadden.  Being in the insurance capital of Hartford, we have a national insurance litigation practice and I was fortunate to have the opportunity to work on some prominent class actions arising from the 2004 hurricanes in Florida and later Hurricane Katrina, including cases involving the applicability of the flood exclusion, statutes known as valued policy laws, and various other issues.  My interest and experience in class actions gradually led me to focus on that area.

In Connecticut courts I’ve defended various kinds of class actions that go beyond insurance, including cases involving products liability, securities, financial services and consumer contracts.

My insurance class action practice usually takes me outside of Connecticut.  I’ve had the pleasure of working on cases in various federal and state courts and collaborating with great lawyers across the country.  While class actions are an increasingly large part of my practice, I don’t do exclusively class action work.  The rest of my practice involves litigating insurance coverage cases, often at the appellate level.  That also frequently takes me outside of Connecticut.  A highlight of my career thus far was working on Standard Fire Ins. Co. v. Knowles, the U.S. Supreme Court’s first Class Action Fairness Act case.  I was Counsel of Record for Standard Fire on the cert petition, and had the pleasure of working with Ted Boutrous on the merits briefing and oral argument.

I started this blog because writing is one of my favorite things to do and I enjoy following developments in class action law, writing about them and engaging in discussion with others who have an in interest in this area.  It’s a welcome break from day-to-day practice, keeps me current, broadens my network and results in some new business.

When I’m not at my desk or flying around the country trying to save insurance companies from the plaintiffs’ bar, or attending a conference on class actions or insurance litigation (for more on those, see the Seminars/Programs page of this blog), I often can be found playing or reading with my young daughter, helping my wife with her real estate and mortgage businesses, reading a book about history or politics, or watching the Boston Red Sox (I managed to find bleacher seats for Game 2 of the 2004 World Series when Curt Schilling pitched with the bloody sock).  When the weather is good I also love to take the ferry to Block Island, Rhode Island and ride a bike or walk the trails there. If you go, I highly recommend the Clay Head Trail.