ILNews

Papageorge: Predictive coding gaining support in courts

January 29, 2014
Keywords
Back to TopCommentsE-mailPrintBookmark and Share
Indiana Lawyer Focus

By John Papageorge

For attorneys handling larger litigation matters, electronically stored information – or ESI – has changed the landscape on how discovery is conducted. The days of manually reviewing boxes of client documents in cold warehouses have taken a backseat to wading through thousands – and in some cases millions – of emails and other electronic records.

Attorneys now are faced with the monumental task of collecting, reviewing and producing their own client’s electronic documents while also reviewing the opposing side’s electronic documents. This can lead to uncomfortable conversations with clients regarding the significant cost of the process.

Papageorge Papageorge

Supporters of predictive coding argue it makes the electronic discovery process less costly and less complicated. Predictive coding – a type of technology-assisted review or computer-assisted review – uses computers and algorithms to identify relevant and responsive documents in an automated manner. Unlike manual review, where the review is done by the most junior staff, predictive coding involves a more senior attorney or small team who review a “seed set” of documents for responsiveness.

The predictive coding system then applies the algorithms to identify properties of the seed set to automatically code the documents not reviewed by the attorneys. As the attorney team continues to code or identify additional responsive documents, the computer predicts the responsiveness of the universe of documents. Attorneys must review sample sets of documents coded by the computer and ultimately decide they have satisfied the requirements of Rule 26. In the end, the computer can identify thousands or even millions of responsive documents without the need for manual attorney review, saving clients thousands of dollars.

Predictive coding is gaining support in federal courts. In February 2012, United States Magistrate Judge Andrew J. Peck of United States District Court for the Southern District of New York, a leading authority on predictive coding, approved the use of predictive coding in Moore v. Publicis Groupe based on the following reasons: (1) the parties’ agreement, (2) the vast amount of electronically stored information (over three million documents), (3) the superiority of computer-assisted review to the available alternatives (i.e., linear manual review or keyword searches), (4) the need for cost effectiveness and proportionality under Rule 26, and (5) the transparent process proposed by one of the parties.

While Judge Peck cautioned that computer-assisted review is not appropriate in all cases, he did urge the bar to seriously consider using predictive coding in large-data-volume cases where it may save litigants a significant amount of legal fees for document review.

In April 2013, U.S. District Judge Robert L. Miller Jr. of the Northern District of Indiana issued a ruling in In re Biomet related to a discovery dispute involving keyword searches and predictive coding. Biomet produced millions of documents by initially using keyword searches to narrow the field of documents, followed by predictive coding to identify relevant documents to be produced. Biomet spent millions of dollars on electronic discovery. Plaintiffs objected to Biomet’s search method and argued that predictive coding should have been used from the outset. Plaintiffs wanted Biomet to start the discovery process over.

While Judge Miller stated that predictive coding from the outset might have unearthed additional documents, he ultimately rejected plaintiffs’ request to start over because Biomet, through the use of keyword searches and predictive coding, had satisfied the requirements of Rule 26 and the cost to start over outweighed any benefits of starting over. Judge Miller did tell plaintiffs that if they wanted documents produced via predictive coding only, they could pay the additional costs.

In May 2013, in Gordon v. Kaleida Health, an employment matter pending in the Western District of New York, the parties asked the court to resolve a discovery dispute involving approximately a quarter of a million electronic documents. For more than a year, the parties attempted, without success, to agree on how to achieve a cost-effective review of defendants’ voluminous emails using keyword search methodology. The court was dissatisfied with the lack of progress using keyword searches, and it pointed to predictive coding as another option.

After defendants decided to use predictive coding, the parties then fought over plaintiffs’ use of a conflicted consultant. Plaintiffs also took the position that the parties must negotiate a transparent protocol to guide the use of predictive coding software. Defendants, on the other hand, asserted that courts do not order parties in ESI discovery disputes to agree to specific protocols to facilitate computer-assisted review, based on the general rule that ESI production is within the sound discretion of the producing party. Because defendants ultimately agreed to meet and discuss the production using predictive coding, the court did not rule on the protocol dispute.

As caselaw develops on predictive coding, the issue of transparency related to predictive coding will be one to watch.

For larger litigation matters, predictive coding is here to stay, although the process is ever-changing. Many issues need to be resolved related to predictive coding, but cooperation and transparency will certainly take center stage. And as costs continue to escalate, courts will be faced with ongoing disputes over who pays for what.

Even after these disputes are resolved, parties must find the key documents that can be used to win the case. Maybe searching boxes of documents in a cold warehouse was not so bad after all.•

__________

John Papageorge – jpapgeorge@taftlaw.com – is a partner with Taft Stettinius & Hollister LLP, practicing complex civil litigation with significant experience handling issues related to electronic discovery. He serves as the firm’s e-discovery practice contact. The opinions expressed are those of the author.

ADVERTISEMENT

Post a comment to this story

COMMENTS POLICY
We reserve the right to remove any post that we feel is obscene, profane, vulgar, racist, sexually explicit, abusive, or hateful.
 
You are legally responsible for what you post and your anonymity is not guaranteed.
 
Posts that insult, defame, threaten, harass or abuse other readers or people mentioned in Indiana Lawyer editorial content are also subject to removal. Please respect the privacy of individuals and refrain from posting personal information.
 
No solicitations, spamming or advertisements are allowed. Readers may post links to other informational websites that are relevant to the topic at hand, but please do not link to objectionable material.
 
We may remove messages that are unrelated to the topic, encourage illegal activity, use all capital letters or are unreadable.
 

Messages that are flagged by readers as objectionable will be reviewed and may or may not be removed. Please do not flag a post simply because you disagree with it.

Sponsored by
ADVERTISEMENT
Subscribe to Indiana Lawyer
  1. OK, take notice. Those wondering just how corrupt the Indiana system is can see the picture in this post. Attorney Donald James did not criticize any judges, he merely, it would seem, caused some clients to file against him and then ignored his own defense. James thus disrespected the system via ignoring all and was also ordered to reimburse the commission $525.88 for the costs of prosecuting the first case against him. Yes, nearly $526 for all the costs, the state having proved it all. Ouch, right? Now consider whistleblower and constitutionalist and citizen journalist Paul Ogden who criticized a judge, defended himself in such a professional fashion as to have half the case against him thrown out by the ISC and was then handed a career ending $10,000 bill as "half the costs" of the state crucifying him. http://www.theindianalawyer.com/ogden-quitting-law-citing-high-disciplinary-fine/PARAMS/article/35323 THE TAKEAWAY MESSAGE for any who have ears to hear ... resist Star Chamber and pay with your career ... welcome to the Indiana system of (cough) justice.

  2. GMA Ranger, I, too, was warned against posting on how the Ind govt was attempting to destroy me professionally, and visit great costs and even destitution upon my family through their processing. No doubt the discussion in Indy today is likely how to ban me from this site (I expect I soon will be), just as they have banned me from emailing them at the BLE and Office of Bar Admission and ADA coordinator -- or, if that fails, whether they can file a complaint against my Kansas or SCOTUS law license for telling just how they operate and offering all of my files over the past decade to any of good will. The elitist insiders running the Hoosier social control mechanisms realize that knowledge and a unified response will be the end of their unjust reign. They fear exposure and accountability. I was banned for life from the Indiana bar for questioning government processing, that is, for being a whistleblower. Hoosier whistleblowers suffer much. I have no doubt, Gma Ranger, of what you report. They fear us, but realize as long as they keep us in fear of them, they can control us. Kinda like the kids' show Ants. Tyrannical governments the world over are being shaken by empowered citizens. Hoosiers dealing with The Capitol are often dealing with tyranny. Time to rise up: https://www.theguardian.com/technology/2017/jan/17/governments-struggling-to-retain-trust-of-citizens-global-survey-finds Back to the Founders! MAGA!

  3. Science is showing us the root of addiction is the lack of connection (with people). Criminalizing people who are lonely is a gross misinterpretation of what data is revealing and the approach we must take to combat mental health. Harsher crimes from drug dealers? where there is a demand there is a market, so make it legal and encourage these citizens to be functioning members of a society with competitive market opportunities. Legalize are "drugs" and quit wasting tax payer dollars on frivolous incarceration. The system is destroying lives and doing it in the name of privatized profits. To demonize loneliness and destroy lives in the land of opportunity is not freedom.

  4. Good luck, but as I have documented in three Hail Mary's to the SCOTUS, two applications (2007 & 2013),a civil rights suit and my own kicked-to-the-curb prayer for mandamus. all supported in detailed affidavits with full legal briefing (never considered), the ISC knows that the BLE operates "above the law" (i.e. unconstitutionally) and does not give a damn. In fact, that is how it was designed to control the lawyers. IU Law Prof. Patrick Baude blew the whistle while he was Ind Bar Examiner President back in 1993, even he was shut down. It is a masonic system that blackballs those whom the elite disdain. Here is the basic thrust:https://en.wikipedia.org/wiki/Blackballing When I asked why I was initially denied, the court's foremost jester wrote back that the ten examiners all voted, and I did not gain the needed votes for approval (whatever that is, probably ten) and thus I was not in .. nothing written, no explanation, just go away or appeal ... and if you appeal and disagree with their system .. proof positive you lack character and fitness. It is both arbitrary and capricious by its very design. The Hoosier legal elites are monarchical minded, and rejected me for life for ostensibly failing to sufficiently respect man's law (due to my stated regard for God's law -- which they questioned me on, after remanding me for a psych eval for holding such Higher Law beliefs) while breaking their own rules, breaking federal statutory law, and violating federal and state constitutions and ancient due process standards .. all well documented as they "processed me" over many years.... yes years ... they have few standards that they will not bulldoze to get to the end desired. And the ISC knows this, and they keep it in play. So sad, And the fed courts refuse to do anything, and so the blackballing show goes on ... it is the Indy way. My final experience here: https://www.scribd.com/document/299040062/Brown-ind-Bar-memo-Pet-cert I will open my files to anyone interested in seeing justice dawn over Indy. My cases are an open book, just ask.

  5. Looks like 2017 will be another notable year for these cases. I have a Grandson involved in a CHINS case that should never have been. He and the whole family are being held hostage by CPS and the 'current mood' of the CPS caseworker. If the parents disagree with a decision, they are penalized. I, along with other were posting on Jasper County Online News, but all were quickly warned to remove posts. I totally understand that some children need these services, but in this case, it was mistakes, covered by coorcement of father to sign papers, lies and cover-ups. The most astonishing thing was within 2 weeks of this child being placed with CPS, a private adoption agency was asking questions regarding child's family in the area. I believe a photo that was taken by CPS manager at the very onset during the CHINS co-ocerment and the intent was to make money. I have even been warned not to post or speak to anyone regarding this case. Parents have completed all requirements, met foster parents, get visitation 2 days a week, and still the next court date is all the way out till May 1, which gives them(CPS) plenty of to time make further demands (which I expect) No trust of these 'seasoned' case managers, as I have already learned too much about their dirty little tricks. If they discover that I have posted here, I expect they will not be happy and penalized parents again. Still a Hostage.

ADVERTISEMENT