ILNews

Papageorge: Predictive coding gaining support in courts

January 29, 2014
Keywords
Back to TopCommentsE-mailPrintBookmark and Share
Indiana Lawyer Focus

By John Papageorge

For attorneys handling larger litigation matters, electronically stored information – or ESI – has changed the landscape on how discovery is conducted. The days of manually reviewing boxes of client documents in cold warehouses have taken a backseat to wading through thousands – and in some cases millions – of emails and other electronic records.

Attorneys now are faced with the monumental task of collecting, reviewing and producing their own client’s electronic documents while also reviewing the opposing side’s electronic documents. This can lead to uncomfortable conversations with clients regarding the significant cost of the process.

Papageorge Papageorge

Supporters of predictive coding argue it makes the electronic discovery process less costly and less complicated. Predictive coding – a type of technology-assisted review or computer-assisted review – uses computers and algorithms to identify relevant and responsive documents in an automated manner. Unlike manual review, where the review is done by the most junior staff, predictive coding involves a more senior attorney or small team who review a “seed set” of documents for responsiveness.

The predictive coding system then applies the algorithms to identify properties of the seed set to automatically code the documents not reviewed by the attorneys. As the attorney team continues to code or identify additional responsive documents, the computer predicts the responsiveness of the universe of documents. Attorneys must review sample sets of documents coded by the computer and ultimately decide they have satisfied the requirements of Rule 26. In the end, the computer can identify thousands or even millions of responsive documents without the need for manual attorney review, saving clients thousands of dollars.

Predictive coding is gaining support in federal courts. In February 2012, United States Magistrate Judge Andrew J. Peck of United States District Court for the Southern District of New York, a leading authority on predictive coding, approved the use of predictive coding in Moore v. Publicis Groupe based on the following reasons: (1) the parties’ agreement, (2) the vast amount of electronically stored information (over three million documents), (3) the superiority of computer-assisted review to the available alternatives (i.e., linear manual review or keyword searches), (4) the need for cost effectiveness and proportionality under Rule 26, and (5) the transparent process proposed by one of the parties.

While Judge Peck cautioned that computer-assisted review is not appropriate in all cases, he did urge the bar to seriously consider using predictive coding in large-data-volume cases where it may save litigants a significant amount of legal fees for document review.

In April 2013, U.S. District Judge Robert L. Miller Jr. of the Northern District of Indiana issued a ruling in In re Biomet related to a discovery dispute involving keyword searches and predictive coding. Biomet produced millions of documents by initially using keyword searches to narrow the field of documents, followed by predictive coding to identify relevant documents to be produced. Biomet spent millions of dollars on electronic discovery. Plaintiffs objected to Biomet’s search method and argued that predictive coding should have been used from the outset. Plaintiffs wanted Biomet to start the discovery process over.

While Judge Miller stated that predictive coding from the outset might have unearthed additional documents, he ultimately rejected plaintiffs’ request to start over because Biomet, through the use of keyword searches and predictive coding, had satisfied the requirements of Rule 26 and the cost to start over outweighed any benefits of starting over. Judge Miller did tell plaintiffs that if they wanted documents produced via predictive coding only, they could pay the additional costs.

In May 2013, in Gordon v. Kaleida Health, an employment matter pending in the Western District of New York, the parties asked the court to resolve a discovery dispute involving approximately a quarter of a million electronic documents. For more than a year, the parties attempted, without success, to agree on how to achieve a cost-effective review of defendants’ voluminous emails using keyword search methodology. The court was dissatisfied with the lack of progress using keyword searches, and it pointed to predictive coding as another option.

After defendants decided to use predictive coding, the parties then fought over plaintiffs’ use of a conflicted consultant. Plaintiffs also took the position that the parties must negotiate a transparent protocol to guide the use of predictive coding software. Defendants, on the other hand, asserted that courts do not order parties in ESI discovery disputes to agree to specific protocols to facilitate computer-assisted review, based on the general rule that ESI production is within the sound discretion of the producing party. Because defendants ultimately agreed to meet and discuss the production using predictive coding, the court did not rule on the protocol dispute.

As caselaw develops on predictive coding, the issue of transparency related to predictive coding will be one to watch.

For larger litigation matters, predictive coding is here to stay, although the process is ever-changing. Many issues need to be resolved related to predictive coding, but cooperation and transparency will certainly take center stage. And as costs continue to escalate, courts will be faced with ongoing disputes over who pays for what.

Even after these disputes are resolved, parties must find the key documents that can be used to win the case. Maybe searching boxes of documents in a cold warehouse was not so bad after all.•

__________

John Papageorge – jpapgeorge@taftlaw.com – is a partner with Taft Stettinius & Hollister LLP, practicing complex civil litigation with significant experience handling issues related to electronic discovery. He serves as the firm’s e-discovery practice contact. The opinions expressed are those of the author.

ADVERTISEMENT

Post a comment to this story

COMMENTS POLICY
We reserve the right to remove any post that we feel is obscene, profane, vulgar, racist, sexually explicit, abusive, or hateful.
 
You are legally responsible for what you post and your anonymity is not guaranteed.
 
Posts that insult, defame, threaten, harass or abuse other readers or people mentioned in Indiana Lawyer editorial content are also subject to removal. Please respect the privacy of individuals and refrain from posting personal information.
 
No solicitations, spamming or advertisements are allowed. Readers may post links to other informational websites that are relevant to the topic at hand, but please do not link to objectionable material.
 
We may remove messages that are unrelated to the topic, encourage illegal activity, use all capital letters or are unreadable.
 

Messages that are flagged by readers as objectionable will be reviewed and may or may not be removed. Please do not flag a post simply because you disagree with it.

Sponsored by
ADVERTISEMENT
Subscribe to Indiana Lawyer
  1. Call it unauthorized law if you must, a regulatory wrong, but it was fraud and theft well beyond that, a seeming crime! "In three specific cases, the hearing officer found that Westerfield did little to no work for her clients but only issued a partial refund or no refund at all." That is theft by deception, folks. "In its decision to suspend Westerfield, the Supreme Court noted that she already had a long disciplinary history dating back to 1996 and had previously been suspended in 2004 and indefinitely suspended in 2005. She was reinstated in 2009 after finally giving the commission a response to the grievance for which she was suspended in 2004." WOW -- was the Indiana Supreme Court complicit in her fraud? Talk about being on notice of a real bad actor .... "Further, the justices noted that during her testimony, Westerfield was “disingenuous and evasive” about her relationship with Tope and attempted to distance herself from him. They also wrote that other aggravating factors existed in Westerfield’s case, such as her lack of remorse." WOW, and yet she only got 18 months on the bench, and if she shows up and cries for them in a year and a half, and pays money to JLAP for group therapy ... back in to ride roughshod over hapless clients (or are they "marks") once again! Aint Hoosier lawyering a great money making adventure!!! Just live for the bucks, even if filthy lucre, and come out a-ok. ME on the other hand??? Lifetime banishment for blowing the whistle on unconstitutional governance. Yes, had I ripped off clients or had ANY disciplinary history for doing that I would have fared better, most likely, as that it would have revealed me motivated by Mammon and not Faith. Check it out if you doubt my reading of this, compare and contrast the above 18 months with my lifetime banishment from court, see appendix for Bar Examiners report which the ISC adopted without substantive review: https://www.scribd.com/doc/299040839/2016Petitionforcert-to-SCOTUS

  2. Wow, over a quarter million dollars? That is a a lot of commissary money! Over what time frame? Years I would guess. Anyone ever try to blow the whistle? Probably not, since most Hoosiers who take notice of such things realize that Hoosier whistleblowers are almost always pilloried. If someone did blow the whistle, they were likely fired. The persecution of whistleblowers is a sure sign of far too much government corruption. Details of my own personal experience at the top of Hoosier governance available upon request ... maybe a "fake news" media outlet will have the courage to tell the stories of Hoosier whistleblowers that the "real" Hoosier media (cough) will not deign to touch. (They are part of the problem.)

  3. So if I am reading it right, only if and when African American college students agree to receive checks labeling them as "Negroes" do they receive aid from the UNCF or the Quaker's Educational Fund? In other words, to borrow from the Indiana Appellate Court, "the [nonprofit] supposed to be [their] advocate, refers to [students] in a racially offensive manner. While there is no evidence that [the nonprofits] intended harm to [African American students], the harm was nonetheless inflicted. [Black students are] presented to [academia and future employers] in a racially offensive manner. For these reasons, [such] performance [is] deficient and also prejudice[ial]." Maybe even DEPLORABLE???

  4. I'm the poor soul who spent over 10 years in prison with many many other prisoners trying to kill me for being charged with a sex offense THAT I DID NOT COMMIT i was in jail for a battery charge for helping a friend leave a boyfriend who beat her I've been saying for over 28 years that i did not and would never hurt a child like that mine or anybody's child but NOBODY wants to believe that i might not be guilty of this horrible crime or think that when i say that ALL the paperwork concerning my conviction has strangely DISAPPEARED or even when the long beach judge re-sentenced me over 14 months on a already filed plea bargain out of another districts court then had it filed under a fake name so i could not find while trying to fight my conviction on appeal in a nut shell people are ALWAYS quick to believe the worst about some one well I DID NOT HURT ANY CHILD EVER IN MY LIFE AND HAVE SAID THIS FOR ALMOST 30 YEARS please if anybody can me get some kind of justice it would be greatly appreciated respectfully written wrongly accused Brian Valenti

  5. A high ranking Indiana supreme Court operative caught red handed leading a group using the uber offensive N word! She must denounce or be denounced! (Or not since she is an insider ... rules do not apply to them). Evidence here: http://m.indianacompanies.us/friends-educational-fund-for-negroes.364110.company.v2#top_info

ADVERTISEMENT