ILNews

Papageorge: Predictive coding gaining support in courts

January 29, 2014
Keywords
Back to TopCommentsE-mailPrintBookmark and Share
Indiana Lawyer Focus

By John Papageorge

For attorneys handling larger litigation matters, electronically stored information – or ESI – has changed the landscape on how discovery is conducted. The days of manually reviewing boxes of client documents in cold warehouses have taken a backseat to wading through thousands – and in some cases millions – of emails and other electronic records.

Attorneys now are faced with the monumental task of collecting, reviewing and producing their own client’s electronic documents while also reviewing the opposing side’s electronic documents. This can lead to uncomfortable conversations with clients regarding the significant cost of the process.

Papageorge Papageorge

Supporters of predictive coding argue it makes the electronic discovery process less costly and less complicated. Predictive coding – a type of technology-assisted review or computer-assisted review – uses computers and algorithms to identify relevant and responsive documents in an automated manner. Unlike manual review, where the review is done by the most junior staff, predictive coding involves a more senior attorney or small team who review a “seed set” of documents for responsiveness.

The predictive coding system then applies the algorithms to identify properties of the seed set to automatically code the documents not reviewed by the attorneys. As the attorney team continues to code or identify additional responsive documents, the computer predicts the responsiveness of the universe of documents. Attorneys must review sample sets of documents coded by the computer and ultimately decide they have satisfied the requirements of Rule 26. In the end, the computer can identify thousands or even millions of responsive documents without the need for manual attorney review, saving clients thousands of dollars.

Predictive coding is gaining support in federal courts. In February 2012, United States Magistrate Judge Andrew J. Peck of United States District Court for the Southern District of New York, a leading authority on predictive coding, approved the use of predictive coding in Moore v. Publicis Groupe based on the following reasons: (1) the parties’ agreement, (2) the vast amount of electronically stored information (over three million documents), (3) the superiority of computer-assisted review to the available alternatives (i.e., linear manual review or keyword searches), (4) the need for cost effectiveness and proportionality under Rule 26, and (5) the transparent process proposed by one of the parties.

While Judge Peck cautioned that computer-assisted review is not appropriate in all cases, he did urge the bar to seriously consider using predictive coding in large-data-volume cases where it may save litigants a significant amount of legal fees for document review.

In April 2013, U.S. District Judge Robert L. Miller Jr. of the Northern District of Indiana issued a ruling in In re Biomet related to a discovery dispute involving keyword searches and predictive coding. Biomet produced millions of documents by initially using keyword searches to narrow the field of documents, followed by predictive coding to identify relevant documents to be produced. Biomet spent millions of dollars on electronic discovery. Plaintiffs objected to Biomet’s search method and argued that predictive coding should have been used from the outset. Plaintiffs wanted Biomet to start the discovery process over.

While Judge Miller stated that predictive coding from the outset might have unearthed additional documents, he ultimately rejected plaintiffs’ request to start over because Biomet, through the use of keyword searches and predictive coding, had satisfied the requirements of Rule 26 and the cost to start over outweighed any benefits of starting over. Judge Miller did tell plaintiffs that if they wanted documents produced via predictive coding only, they could pay the additional costs.

In May 2013, in Gordon v. Kaleida Health, an employment matter pending in the Western District of New York, the parties asked the court to resolve a discovery dispute involving approximately a quarter of a million electronic documents. For more than a year, the parties attempted, without success, to agree on how to achieve a cost-effective review of defendants’ voluminous emails using keyword search methodology. The court was dissatisfied with the lack of progress using keyword searches, and it pointed to predictive coding as another option.

After defendants decided to use predictive coding, the parties then fought over plaintiffs’ use of a conflicted consultant. Plaintiffs also took the position that the parties must negotiate a transparent protocol to guide the use of predictive coding software. Defendants, on the other hand, asserted that courts do not order parties in ESI discovery disputes to agree to specific protocols to facilitate computer-assisted review, based on the general rule that ESI production is within the sound discretion of the producing party. Because defendants ultimately agreed to meet and discuss the production using predictive coding, the court did not rule on the protocol dispute.

As caselaw develops on predictive coding, the issue of transparency related to predictive coding will be one to watch.

For larger litigation matters, predictive coding is here to stay, although the process is ever-changing. Many issues need to be resolved related to predictive coding, but cooperation and transparency will certainly take center stage. And as costs continue to escalate, courts will be faced with ongoing disputes over who pays for what.

Even after these disputes are resolved, parties must find the key documents that can be used to win the case. Maybe searching boxes of documents in a cold warehouse was not so bad after all.•

__________

John Papageorge – jpapgeorge@taftlaw.com – is a partner with Taft Stettinius & Hollister LLP, practicing complex civil litigation with significant experience handling issues related to electronic discovery. He serves as the firm’s e-discovery practice contact. The opinions expressed are those of the author.

ADVERTISEMENT

Post a comment to this story

COMMENTS POLICY
We reserve the right to remove any post that we feel is obscene, profane, vulgar, racist, sexually explicit, abusive, or hateful.
 
You are legally responsible for what you post and your anonymity is not guaranteed.
 
Posts that insult, defame, threaten, harass or abuse other readers or people mentioned in Indiana Lawyer editorial content are also subject to removal. Please respect the privacy of individuals and refrain from posting personal information.
 
No solicitations, spamming or advertisements are allowed. Readers may post links to other informational websites that are relevant to the topic at hand, but please do not link to objectionable material.
 
We may remove messages that are unrelated to the topic, encourage illegal activity, use all capital letters or are unreadable.
 

Messages that are flagged by readers as objectionable will be reviewed and may or may not be removed. Please do not flag a post simply because you disagree with it.

Sponsored by
ADVERTISEMENT
Subscribe to Indiana Lawyer
  1. It really doesn't matter what the law IS, if law enforcement refuses to take reports (or take them seriously), if courts refuse to allow unrepresented parties to speak (especially in Small Claims, which is supposedly "informal"). It doesn't matter what the law IS, if constituents are unable to make effective contact or receive any meaningful response from their representatives. Two of our pets were unnecessarily killed; court records reflect that I "abandoned" them. Not so; when I was denied one of them (and my possessions, which by court order I was supposed to be able to remove), I went directly to the court. And earlier, when I tried to have the DV PO extended (it expired while the subject was on probation for violating it), the court denied any extension. The result? Same problems, less than eight hours after expiration. Ironic that the county sheriff was charged (and later pleaded to) with intimidation, but none of his officers seemed interested or capable of taking such a report from a private citizen. When I learned from one officer what I needed to do, I forwarded audio and transcript of one occurrence and my call to law enforcement (before the statute of limitations expired) to the prosecutor's office. I didn't even receive an acknowledgement. Earlier, I'd gone in to the prosecutor's office and been told that the officer's (written) report didn't match what I said occurred. Since I had the audio, I can only say that I have very little faith in Indiana government or law enforcement.

  2. One can only wonder whether Mr. Kimmel was paid for his work by Mr. Burgh ... or whether that bill fell to the citizens of Indiana, many of whom cannot afford attorneys for important matters. It really doesn't take a judge(s) to know that "pavement" can be considered a deadly weapon. It only takes a brain and some education or thought. I'm glad to see the conviction was upheld although sorry to see that the asphalt could even be considered "an issue".

  3. In response to bryanjbrown: thank you for your comment. I am familiar with Paul Ogden (and applaud his assistance to Shirley Justice) and have read of Gary Welsh's (strange) death (and have visited his blog on many occasions). I am not familiar with you (yet). I lived in Kosciusko county, where the sheriff was just removed after pleading in what seems a very "sweetheart" deal. Unfortunately, something NEEDS to change since the attorneys won't (en masse) stand up for ethics (rather making a show to please the "rules" and apparently the judges). I read that many attorneys are underemployed. Seems wisdom would be to cull the herd and get rid of the rotting apples in practice and on the bench, for everyone's sake as well as justice. I'd like to file an attorney complaint, but I have little faith in anything (other than the most flagrant and obvious) resulting in action. My own belief is that if this was medicine, there'd be maimed and injured all over and the carnage caused by "the profession" would be difficult to hide. One can dream ... meanwhile, back to figuring out to file a pro se "motion to dismiss" as well as another court required paper that Indiana is so fond of providing NO resources for (unlike many other states, who don't automatically assume that citizens involved in the court process are scumbags) so that maybe I can get the family law attorney - whose work left me with no settlement, no possessions and resulted in the death of two pets (etc ad nauseum) - to stop abusing the proceedings supplemental and small claims rules and using it as a vehicle for harassment and apparently, amusement.

  4. Been on social security sense sept 2011 2massive strokes open heart surgery and serious ovarian cancer and a blood clot in my lung all in 14 months. Got a letter in may saying that i didn't qualify and it was in form like i just applied ,called social security she said it don't make sense and you are still geting a check in june and i did ,now i get a check from my part D asking for payment for july because there will be no money for my membership, call my prescription coverage part D and confirmed no check will be there.went to social security they didn't want to answer whats going on just said i should of never been on it .no one knows where this letter came from was California im in virginia and been here sense my strokes and vcu filed for my disability i was in the hospital when they did it .It's like it was a error . My ,mothers social security was being handled in that office in California my sister was dealing with it and it had my social security number because she died last year and this letter came out of the same office and it came at the same time i got the letter for my mother benefits for death and they had the same date of being typed just one was on the mail Saturday and one on Monday. . I think it's a mistake and it should been fixed instead there just getting rid of me .i never got a formal letter saying when i was being tsken off.

  5. Employers should not have racially discriminating mind set. It has huge impact on the society what the big players do or don't do in the industry. Background check is conducted just to verify whether information provided by the prospective employee is correct or not. It doesn't have any direct combination with the rejection of the employees. If there is rejection, there should be something effective and full-proof things on the table that may keep the company or the people associated with it in jeopardy.

ADVERTISEMENT