{"id":1957,"date":"2023-02-06T19:31:51","date_gmt":"2023-02-06T19:31:51","guid":{"rendered":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/speakers\/scott-green-copy\/"},"modified":"2023-03-13T14:06:49","modified_gmt":"2023-03-13T14:06:49","slug":"scott-zoldi","status":"publish","type":"page","link":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/speakers\/scott-zoldi\/","title":{"rendered":"Scott Zoldi"},"content":{"rendered":"\n
\n
\n
\n
\n \n
\n
\n \"Scott \n <\/div>\n \n \n
\n

\n Scott Zoldi <\/h3>\n <\/div>\n \n <\/div>\n <\/div>\n
\n \n
\n
\n

Scott Zoldi<\/span><\/h1>\n

Chief Analytics Officer at FICO<\/span><\/h1>\n
\n

Scott Zoldi\u202fis chief analytics officer at FICO responsible for advancing the company’s leadership in artificial intelligence (AI) and analytics in its product and technology solutions. At FICO Scott has authored more than 120 analytic patents, with 80 granted and 47 pending. Scott is actively involved in the development of analytics applications, Responsible AI technologies and AI governance frameworks, the latter including\u202fFICO’s blockchain-based\u202fmodel development governance methodology \u2013 and was most recently awarded the Future Thinking Award at Corinium\u2019s Business of Data Awards Gala.\u202fScott is a member of the Board of Advisors of FinRegLab, a Cybersecurity Advisory Board Member of the California Technology Council, and a Board Member of Tech San Diego and the San Diego Cyber Center of Excellence. Scott\u202freceived his Ph.D. in theoretical and computational physics from Duke University.<\/p>\n<\/div> <\/div>\n<\/div>\n <\/div>\n <\/div>\n <\/div>\n

\n
\n
\n \n
\n
\n
Track: Behavioral Analytics<\/h6> <\/div>\n<\/div>\n\n
\n
\n

Responsible AI: Maturity in AI Development<\/h2>\n

This paper presents an empirical analysis of health insurance claims data to explore telemedicine outcomes. Specifically, I utilize causal forests and a retrospective matched case control study design to demonstrate statistically significant changes in costs, utilization, and medication adherence of telehealth users. Every other day brings news of how AI has misbehaved, concerns of unethical or unsafe use, and complexity outweighing data scientist understanding. While AI provides a great business opportunity, increasing social awareness and regulation point to the need for thoughtful, demonstrated proper development of models and AI systems.  Regulators have stepped in with a slew of regulatory frameworks such as GDPR, AI Act and IEEE standards to help current and future standards to regulate AI. Increasingly mature organizations are focusing on AI and machine learning built at the same level of sophistication and with defined\/monitored processes as software. The first step in that journey requires firm model development governance standards across the corporation that ensure alignment to these corporate standards and demonstrated accountability to following the standard during model development. This contrasts with the older methods of inferring rightness\/wrongness of models built afterwards by model governance teams.   Interpretability of the model is key to achieving transparency and explainability. We will review novel interpretable latent feature based neural networks that allow for the required transparency in responsible AI applications. This transparency enables explainability of the model through model architecture (as compared to inference methods), for example, by using highlander constraints to limit each hidden node connections. This forces the algorithm to find a solution which is inherently interpretable, where each hidden node can be easily explained in terms of non-linear interaction terms that are easy to understand, test, and defend by human experts. This transparent architecture also enables bias testing of the latent features across protected classes. This makes it possible to drive ethics testing through exposing learnt latent features (which drive model outcomes) for bias. Once offending imputed relationships are exposed, they can be eliminated from the model in a retrain process. Further, when the model is deemed ethical specific thresholds for bias drift are also produced for monitoring.Auditability is accomplished through configuration of a model development governance blockchain that codifies and enforces the corporation\u2019s model development standards. An auditable and persistent record of all actions and decisions pertaining to the model and related asset development as well as production of quantities for continuous monitoring in production is maintained on blockchain. The combination of enforcing model development standards and monitoring that are maintained in production through Auditable AI is key to responsible AI. Together these three tenants of responsible AI drive the standards, processes, and monitoring required to ensure that responsible AI development can mirror software development processes\/tools already in place for decades for critical software applications.<\/p>


<\/div>

<\/p> <\/div>\n<\/div>\n <\/div>\n <\/div>\n <\/div>\n <\/div>\n","protected":false},"excerpt":{"rendered":"

Scott Zoldi Scott Zoldi Chief Analytics Officer at FICO Scott Zoldi\u202fis chief analytics officer at FICO responsible for advancing the company’s leadership in artificial intelligence (AI) and analytics in its product and technology solutions. At FICO Scott has authored more than 120 analytic patents, with 80 granted and 47 pending. Scott is actively involved in […]<\/p>\n","protected":false},"author":1001094,"featured_media":1963,"parent":712,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"content-type":"","footnotes":""},"class_list":["post-1957","page","type-page","status-publish","has-post-thumbnail","hentry","has-post-title","has-post-date","has-post-category","has-post-tag","has-post-comment","has-post-author",""],"acf":[],"yoast_head":"\nScott Zoldi - 2023 INFORMS Business Analytics Conference<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/speakers\/scott-zoldi\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Scott Zoldi\" \/>\n<meta property=\"og:description\" content=\"Scott Zoldi Scott Zoldi Chief Analytics Officer at FICO Scott Zoldi\u202fis chief analytics officer at FICO responsible for advancing the company’s leadership in artificial intelligence (AI) and analytics in its product and technology solutions. At FICO Scott has authored more than 120 analytic patents, with 80 granted and 47 pending. Scott is actively involved in […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/speakers\/scott-zoldi\/\" \/>\n<meta property=\"og:site_name\" content=\"2023 INFORMS Business Analytics Conference\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/INFORMSpage\/\" \/>\n<meta property=\"article:modified_time\" content=\"2023-03-13T14:06:49+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/files\/2023\/02\/Scott_Zoldi.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"300\" \/>\n\t<meta property=\"og:image:height\" content=\"300\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@2023_Analytics\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/speakers\/scott-zoldi\/\",\"url\":\"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/speakers\/scott-zoldi\/\",\"name\":\"Scott Zoldi - 2023 INFORMS Business Analytics Conference\",\"isPartOf\":{\"@id\":\"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/speakers\/scott-zoldi\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/speakers\/scott-zoldi\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/files\/2023\/02\/Scott_Zoldi.jpg\",\"datePublished\":\"2023-02-06T19:31:51+00:00\",\"dateModified\":\"2023-03-13T14:06:49+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/speakers\/scott-zoldi\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/speakers\/scott-zoldi\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/speakers\/scott-zoldi\/#primaryimage\",\"url\":\"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/files\/2023\/02\/Scott_Zoldi.jpg\",\"contentUrl\":\"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/files\/2023\/02\/Scott_Zoldi.jpg\",\"width\":300,\"height\":300},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/speakers\/scott-zoldi\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Speakers\",\"item\":\"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/speakers\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Scott Zoldi\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/#website\",\"url\":\"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/\",\"name\":\"2023 INFORMS Business Analytics Conference\",\"description\":\"Aurora, CO | April 16-18, 2023\",\"publisher\":{\"@id\":\"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/#organization\",\"name\":\"INFORMS\",\"url\":\"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/files\/2022\/03\/INFORMS_Logo_full_color.jpg\",\"contentUrl\":\"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/files\/2022\/03\/INFORMS_Logo_full_color.jpg\",\"width\":300,\"height\":72,\"caption\":\"INFORMS\"},\"image\":{\"@id\":\"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/INFORMSpage\/\",\"https:\/\/x.com\/2023_Analytics\",\"http:\/\/instagram.com\/informs_orms\",\"https:\/\/www.linkedin.com\/groups\/82644\/profile\",\"https:\/\/www.pinterest.com\/informs\/_saved\/\",\"https:\/\/www.youtube.com\/user\/INFORMSonline\",\"https:\/\/en.wikipedia.org\/wiki\/Institute_for_Operations_Research_and_the_Management_Sciences\"]}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Scott Zoldi - 2023 INFORMS Business Analytics Conference","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/speakers\/scott-zoldi\/","og_locale":"en_US","og_type":"article","og_title":"Scott Zoldi","og_description":"Scott Zoldi Scott Zoldi Chief Analytics Officer at FICO Scott Zoldi\u202fis chief analytics officer at FICO responsible for advancing the company’s leadership in artificial intelligence (AI) and analytics in its product and technology solutions. At FICO Scott has authored more than 120 analytic patents, with 80 granted and 47 pending. Scott is actively involved in […]","og_url":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/speakers\/scott-zoldi\/","og_site_name":"2023 INFORMS Business Analytics Conference","article_publisher":"https:\/\/www.facebook.com\/INFORMSpage\/","article_modified_time":"2023-03-13T14:06:49+00:00","og_image":[{"width":300,"height":300,"url":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/files\/2023\/02\/Scott_Zoldi.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_site":"@2023_Analytics","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/speakers\/scott-zoldi\/","url":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/speakers\/scott-zoldi\/","name":"Scott Zoldi - 2023 INFORMS Business Analytics Conference","isPartOf":{"@id":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/#website"},"primaryImageOfPage":{"@id":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/speakers\/scott-zoldi\/#primaryimage"},"image":{"@id":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/speakers\/scott-zoldi\/#primaryimage"},"thumbnailUrl":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/files\/2023\/02\/Scott_Zoldi.jpg","datePublished":"2023-02-06T19:31:51+00:00","dateModified":"2023-03-13T14:06:49+00:00","breadcrumb":{"@id":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/speakers\/scott-zoldi\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/meetings.informs.org\/wordpress\/analytics2023\/speakers\/scott-zoldi\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/speakers\/scott-zoldi\/#primaryimage","url":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/files\/2023\/02\/Scott_Zoldi.jpg","contentUrl":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/files\/2023\/02\/Scott_Zoldi.jpg","width":300,"height":300},{"@type":"BreadcrumbList","@id":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/speakers\/scott-zoldi\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/"},{"@type":"ListItem","position":2,"name":"Speakers","item":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/speakers\/"},{"@type":"ListItem","position":3,"name":"Scott Zoldi"}]},{"@type":"WebSite","@id":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/#website","url":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/","name":"2023 INFORMS Business Analytics Conference","description":"Aurora, CO | April 16-18, 2023","publisher":{"@id":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/#organization","name":"INFORMS","url":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/#\/schema\/logo\/image\/","url":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/files\/2022\/03\/INFORMS_Logo_full_color.jpg","contentUrl":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/files\/2022\/03\/INFORMS_Logo_full_color.jpg","width":300,"height":72,"caption":"INFORMS"},"image":{"@id":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/INFORMSpage\/","https:\/\/x.com\/2023_Analytics","http:\/\/instagram.com\/informs_orms","https:\/\/www.linkedin.com\/groups\/82644\/profile","https:\/\/www.pinterest.com\/informs\/_saved\/","https:\/\/www.youtube.com\/user\/INFORMSonline","https:\/\/en.wikipedia.org\/wiki\/Institute_for_Operations_Research_and_the_Management_Sciences"]}]}},"builder_content":"<img src=\"\/wordpress\/analytics2023\/files\/2023\/02\/Scott_Zoldi.jpg\" title=\"Scott Zoldi\" alt=\"Scott Zoldi headshot\"> <h3> Scott Zoldi <\/h3>\n<h1>Scott Zoldi<\/h1> <h1>Chief Analytics Officer at FICO<\/h1>\n<p>Scott Zoldi\u202fis chief analytics officer at FICO responsible for advancing the company's leadership in artificial intelligence (AI) and analytics in its product and technology solutions. At FICO Scott has authored more than 120 analytic patents, with 80 granted and 47 pending. Scott is actively involved in the development of analytics applications, Responsible AI technologies and AI governance frameworks, the latter including\u202fFICO's blockchain-based\u202fmodel development governance methodology \u2013 and was most recently awarded the Future Thinking Award at Corinium\u2019s Business of Data Awards Gala.\u202fScott is a member of the Board of Advisors of FinRegLab, a Cybersecurity Advisory Board Member of the California Technology Council, and a Board Member of Tech San Diego and the San Diego Cyber Center of Excellence. Scott\u202freceived his Ph.D. in theoretical and computational physics from Duke University.<\/p>\n<h6>Track: Behavioral Analytics<\/h6>\n<h2>Responsible AI: Maturity in AI Development<\/h2> <p>This paper presents an empirical analysis of health insurance claims data to explore telemedicine outcomes. Specifically, I utilize causal forests and a retrospective matched case control study design to demonstrate statistically significant changes in costs, utilization, and medication adherence of telehealth users. Every other day brings news of how AI has misbehaved, concerns of unethical or unsafe use, and complexity outweighing data scientist understanding. While AI provides a great business opportunity, increasing social awareness and regulation point to the need for thoughtful, demonstrated proper development of models and AI systems.  Regulators have stepped in with a slew of regulatory frameworks such as GDPR, AI Act and IEEE standards to help current and future standards to regulate AI. Increasingly mature organizations are focusing on AI and machine learning built at the same level of sophistication and with defined\/monitored processes as software. The first step in that journey requires firm model development governance standards across the corporation that ensure alignment to these corporate standards and demonstrated accountability to following the standard during model development. This contrasts with the older methods of inferring rightness\/wrongness of models built afterwards by model governance teams.   Interpretability of the model is key to achieving transparency and explainability. We will review novel interpretable latent feature based neural networks that allow for the required transparency in responsible AI applications. This transparency enables explainability of the model through model architecture (as compared to inference methods), for example, by using highlander constraints to limit each hidden node connections. This forces the algorithm to find a solution which is inherently interpretable, where each hidden node can be easily explained in terms of non-linear interaction terms that are easy to understand, test, and defend by human experts. This transparent architecture also enables bias testing of the latent features across protected classes. This makes it possible to drive ethics testing through exposing learnt latent features (which drive model outcomes) for bias. Once offending imputed relationships are exposed, they can be eliminated from the model in a retrain process. Further, when the model is deemed ethical specific thresholds for bias drift are also produced for monitoring.Auditability is accomplished through configuration of a model development governance blockchain that codifies and enforces the corporation\u2019s model development standards. An auditable and persistent record of all actions and decisions pertaining to the model and related asset development as well as production of quantities for continuous monitoring in production is maintained on blockchain. The combination of enforcing model development standards and monitoring that are maintained in production through Auditable AI is key to responsible AI. Together these three tenants of responsible AI drive the standards, processes, and monitoring required to ensure that responsible AI development can mirror software development processes\/tools already in place for decades for critical software applications.<\/p><br><p><\/p>","_links":{"self":[{"href":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/wp-json\/wp\/v2\/pages\/1957","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/wp-json\/wp\/v2\/users\/1001094"}],"replies":[{"embeddable":true,"href":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/wp-json\/wp\/v2\/comments?post=1957"}],"version-history":[{"count":11,"href":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/wp-json\/wp\/v2\/pages\/1957\/revisions"}],"predecessor-version":[{"id":3567,"href":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/wp-json\/wp\/v2\/pages\/1957\/revisions\/3567"}],"up":[{"embeddable":true,"href":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/wp-json\/wp\/v2\/pages\/712"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/wp-json\/wp\/v2\/media\/1963"}],"wp:attachment":[{"href":"https:\/\/meetings.informs.org\/wordpress\/analytics2023\/wp-json\/wp\/v2\/media?parent=1957"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}