Study shows racial bias in evaluating legal writing

April 25, 2014
Back to TopCommentsE-mailPrintBookmark and Share

When handing out the same memo to various law partners to critique under the guise of a study on the writing competencies of young attorneys, researchers discovered law partners found more errors in the memos they believed were written by an African-American attorney.

Nextions wanted to explore the idea of confirmation bias in racial perceptions of writing skills. It received 53 responses from partners who either looked at the same memo written by "Thomas Meyer," an African-American third-year associate from NYU Law School; or the memo written by "Thomas Meyer," a Caucasian third-year associate from NYU Law School.

In a previous study, researchers found evidence that supervising lawyers perceived African-American lawyers to be subpar in their writing skills as compared to their Caucasian counterparts. The study results released this month by Nextions confirmed that.

African-American Thomas Meyer’s memo averaged a 3.2/5 rating; Caucasian Thomas Meyer’s memo averaged a 4.1/5 rating. Comments were also generally more positive for Caucasian Thomas Meyer.

The memo contained 22 different errors: seven minor spelling/grammar errors; six substantive technical writing errors; five errors in fact and four errors in the analysis of the facts. The memo was sent to 39 Caucasian partners and 21 racial/ethnic minorities; 23 were women and 37 were men.

“We undertook this study with the hypothesis that unconscious confirmation bias in a supervising lawyer’s assessment of legal writing would result in a more negative rating if that writing was submitted by an African American lawyer in comparison to the same submission by a Caucasian lawyer. In order to create a study where we could control for enough variables to truly see the impact of confirmation bias, we did not study the potential variances that can be caused due to the intersection of race/ethnicity, gender, generational differences and other such salient identities. Thus, our conclusion is limited to the impact of confirmation bias in the evaluation of African American men in comparison to Caucasian men. We do not know (although we plan to study the issue in the very near future!) how this impact will splinter or strengthen when gender and/or other identities are introduced,” the researchers wrote in their summary.

“The data findings affirmed our hypothesis, but they also illustrated that the confirmation bias on the part of the evaluators occurred in the data collection phase of their evaluation processes – the identification of the errors – and not the final analysis phase. When expecting to find fewer errors, we find fewer errors. When expecting to find more errors, we find more errors. That is unconscious confirmation bias. Our evaluators unconsciously found more of the errors in the ‘African American’ Thomas Meyer’s memo, but the final rating process was a conscious and unbiased analysis based on the number of errors found. When partners say that they are evaluating assignments without bias, they are probably right in believing that there is no bias in the assessment of the errors found; however, if there is bias in the finding of the errors, even a fair final analysis cannot, and will not, result in a fair result.”

Take a look at the study and let me know what you think.
 

ADVERTISEMENT
  • Great to see Dr Arin moving on
    The author of this report was previously all about getting separate but equal restrooms for womyn attorneys (but not female secretaries), so it is really good to see her moving on from that: Reeves acknowledged that there may be a desire for inclusion; however, there is still inadequate support for it. An example she provided was a woman lawyer who did not have a designated restroom, as there were only two: one for women secretaries and the other for male lawyers." http://www.lewisu.edu/news/Newsarticle.htm?PArticleID=5722#.U1vG1Vda80M
    • Thinking about it
      Who circuluates a memo with the race of the author on it? What to expect next month, sexual preferences listed?
    • Does the study confirm unconscious bias on the part of the author?
      It seems to me that the study is a pretty thin one where it is possible that it reveals more about the unconscious confirmation bias of the author than of the subjects. Perhaps she has the belief that law partners are biased against minorities and women and used the information to confirm her belief. Looking at the errors detected by the reviewers, the only place where there was a significant difference in errors detected was in the spelling errors (2.9 for the "Caucasian" vs. 5.8 for the "African-American") whereas the error differences in technical writing (4.1 vs. 4.9) and facts (3.2 vs. 3.9). That could easily be interpreted to reach the conclusion that spelling counts and the reviewers have a more negative view about the work of poor spellers. Of course, the point can be made that the partners found more spelling errors in the work of the "African-American" associate based on their biases; however, by not doing a more thorough job, the author detracts from her point.
      • Direct hit
        I was thinking just the same, Larry. Who crunches her stats? What was the confidence interval? Will this "study" be peer reviewed? Is she not a "consultant" seeking to peddle her "services" in light of this thin social research? Is this science or mere rhetoric and manipulation parading as social science? I have to say that the probability is that it would never pass muster in even an undergrad class on social science. Rather sad to see such shody work promoted here, but I guess since it arrived at the "right" (make that "left") conclusions it is good to go, breaking news, justification for indicting the entire social order. Coming next month, how inherent biases cause us to discriminate against left handed typists.

      Post a comment to this story

      COMMENTS POLICY
      We reserve the right to remove any post that we feel is obscene, profane, vulgar, racist, sexually explicit, abusive, or hateful.
       
      You are legally responsible for what you post and your anonymity is not guaranteed.
       
      Posts that insult, defame, threaten, harass or abuse other readers or people mentioned in Indiana Lawyer editorial content are also subject to removal. Please respect the privacy of individuals and refrain from posting personal information.
       
      No solicitations, spamming or advertisements are allowed. Readers may post links to other informational websites that are relevant to the topic at hand, but please do not link to objectionable material.
       
      We may remove messages that are unrelated to the topic, encourage illegal activity, use all capital letters or are unreadable.
       

      Messages that are flagged by readers as objectionable will be reviewed and may or may not be removed. Please do not flag a post simply because you disagree with it.

      Sponsored by
      ADVERTISEMENT
      1. I'm glad that attorney Carl Hayes, who represented the BMV in this case, is able to say that his client "is pleased to have resolved the issue". Everyone makes mistakes, even bureaucratic behemoths like Indiana's BMV. So to some extent we need to be forgiving of such mistakes. But when those mistakes are going to cost Indiana taxpayers millions of dollars to rectify (because neither plaintiff's counsel nor Mr. Hayes gave freely of their services, and the BMV, being a state-funded agency, relies on taxpayer dollars to pay these attorneys their fees), the agency doesn't have a right to feel "pleased to have resolved the issue". One is left wondering why the BMV feels so pleased with this resolution? The magnitude of the agency's overcharges might suggest to some that, perhaps, these errors were more than mere oversight. Could this be why the agency is so "pleased" with this resolution? Will Indiana motorists ever be assured that the culture of incompetence (if not worse) that the BMV seems to have fostered is no longer the status quo? Or will even more "overcharges" and lawsuits result? It's fairly obvious who is really "pleased to have resolved the issue", and it's not Indiana's taxpayers who are on the hook for the legal fees generated in these cases.

      2. We are a Finance Industry Company professionals with over 15 Years Experience and a focus on providing Bank Guarantee and Standby Letter of Credit from some of the World Top 25 Prime Banks primarily from Barclays, Deutsche Bank, HSBC,Credit Suisse e.t.c. FEATURES: Amounts from $1 million to 5 Billion+ Euro’s or US Dollars Great Attorney Trust Account Protection Delivered via MT760, MT799 and MT103 Swift with Full Bank Responsibility Brokers Always Protected Purchase Instrument of BG/SBLC : 32%+2% Min Face Value cut = EUR/USD 1M-5B Lease Instrument of BG/SBLC : 4%+2% Min Face Value cut = EUR/USD 1M-5B Interested Agents/Brokers, Investors and Individual proposing international project funding should contact us for directives.We will be glad to share our working procedures with you upon request. We Facilitate Bank instruments SBLC for Lease and Purchase. Whether you are a new startup, medium or large establishment that needs a financial solution to fund/get your project off the ground or business looking for extra capital to expand your operation,our company renders credible and trusted bank guarantee provider who are willing to fund and give financing solutions that suits your specific business needs. We help you secure and issue sblc and bank guarantee for your trade, projects and investment from top AA rated world Banks like HSBC, Barclays, Dutch Ing Bank, Llyods e.t.c because that’s the best and safest strategy for our clients.e.t.c DESCRIPTION OF INSTRUMENTS 1. Instrument: Funds backed Bank Guarantee(BG) ICC-600 2. Currency : USD/EURO 3. Age of Issue: Fresh Cut 4. Term: One year and One day 5. Contract Amount: United State Dollars/Euros (Buyers Face Value) 6. Price : Buy:32%+1, Lease: 4%+2 7. Subsequent tranches: To be mutually agreed between both parties 8. Issuing Bank: Top RATED world banks like HSBC, Barclays, ING Dutch Bank, Llyods e.t.c 9. Delivery Term: Pre advise MT199 or MT799 first. Followed By SWIFT MT760 10. Payment Term: MT799 & Settlement via MT103 11. Hard Copy: By Bank Bonded Courier Interested Agents,Brokers, Investors and Individual proposing international project funding should contact us for directives.We will be glad to share our working procedures with you upon request. Name:Richardson McAnthony Contact Mail : intertekfinance@gmail.com

      3. Affordable Loan Offer (ericloanfinance@hotmail.com) NEED A LOAN?Sometime i really wanna help those in a financial problems.i was wondering why some people talks about inability to get a loan from a bank/company. have you guys ever try Eric Benson lending service.it cost dollars to loan from their company. my aunty from USA,just got a home loan from Eric Benson Lending banking card service.and they gave her a loan of 8,000,000 USD. they give out loan from 100,000 USD - 100,000,000 USD. try it yourself and testimony. have a great day as you try.Kiss & Hug. Contact E-mail: ericloanfinance@hotmail.com

      4. From the article's fourth paragraph: "Her work underscores the blurry lines in Russia between the government and businesses . . ." Obviously, the author of this piece doesn't pay much attention to the "blurry lines" between government and businesses that exist in the United States. And I'm not talking only about Trump's alleged conflicts of interest. When lobbyists for major industries (pharmaceutical, petroleum, insurance, etc) have greater access to this country's elected representatives than do everyday individuals (i.e., voters), then I would say that the lines between government and business in the United States are just as blurry, if not more so, than in Russia.

      5. For some strange reason this story, like many on this ezine that question the powerful, seems to have been released in two formats. Prior format here: http://www.theindianalawyer.com/nominees-selected-for-us-attorney-in-indiana/PARAMS/article/44263 That observed, I must note that it is quite refreshing that denizens of the great unwashed (like me) can be allowed to openly question powerful elitists at ICE MILLER who are on the public dole like Selby. Kudos to those at this ezine who understand that they cannot be mere lapdogs to the powerful and corrupt, lest freedom bleed out. If you wonder why the Senator resisted Selby, consider reading the comments here for a theory: http://www.theindianalawyer.com/nominees-selected-for-us-attorney-in-indiana/PARAMS/article/44263

      ADVERTISEMENT