{"id":177,"date":"2024-05-31T20:00:29","date_gmt":"2024-05-31T20:00:29","guid":{"rendered":"https:\/\/wsw-int.de\/?p=177"},"modified":"2024-10-25T15:27:13","modified_gmt":"2024-10-25T15:27:13","slug":"foundation-models-for-numerical-tasks","status":"publish","type":"post","link":"https:\/\/multai.eu\/en_gb\/foundation-models-for-numerical-tasks\/","title":{"rendered":"Foundation Models for Numerical Tasks"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\">1. Language models<\/h2>\n\n\n\n<p>By now, we all know that large language models (LLMs) are very capable in qualitative and language-based tasks. The jury is still out, however, concerning their \ud835\udc2b\ud835\udc1e\ud835\udc1a\ud835\udc2c\ud835\udc28\ud835\udc27\ud835\udc22\ud835\udc27\ud835\udc20 \ud835\udc1a\ud835\udc27\ud835\udc1d \ud835\udc27\ud835\udc2e\ud835\udc26\ud835\udc1e\ud835\udc2b\ud835\udc22\ud835\udc1c\ud835\udc1a\ud835\udc25 skills.<br><br>Researchers at the University of Chicago&#8217;s Booth School of Business (my alma mater) used \ud835\udc05\ud835\udc22\ud835\udc27\ud835\udc1a\ud835\udc27\ud835\udc1c\ud835\udc22\ud835\udc1a\ud835\udc25 \ud835\udc12\ud835\udc2d\ud835\udc1a\ud835\udc2d\ud835\udc1e\ud835\udc26\ud835\udc1e\ud835\udc27\ud835\udc2d \ud835\udc00\ud835\udc27\ud835\udc1a\ud835\udc25\ud835\udc32\ud835\udc2c\ud835\udc22\ud835\udc2c (FSA) to test LLMs\u2019 ability to analyze and synthesize purely financial numbers (paper <a href=\"https:\/\/papers.ssrn.com\/sol3\/papers.cfm?abstract_id=4835311\">here<\/a>). The task was to predict whether earnings will grow or decline in the following period (various timeframes tested). The LLM (GPT 4.0 Turbo) was not given any textual information, just numbers, as shown in Fig. 1. <\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img fetchpriority=\"high\" decoding=\"async\" width=\"765\" height=\"1024\" src=\"https:\/\/wsw-int.de\/wp-content\/uploads\/2024\/05\/Screenshot-2024-05-30-123204-765x1024.png\" alt=\"\" class=\"wp-image-180\" srcset=\"https:\/\/multai.eu\/wp-content\/uploads\/2024\/05\/Screenshot-2024-05-30-123204-765x1024.png 765w, https:\/\/multai.eu\/wp-content\/uploads\/2024\/05\/Screenshot-2024-05-30-123204-224x300.png 224w, https:\/\/multai.eu\/wp-content\/uploads\/2024\/05\/Screenshot-2024-05-30-123204-768x1028.png 768w, https:\/\/multai.eu\/wp-content\/uploads\/2024\/05\/Screenshot-2024-05-30-123204-1148x1536.png 1148w, https:\/\/multai.eu\/wp-content\/uploads\/2024\/05\/Screenshot-2024-05-30-123204.png 1260w\" sizes=\"(max-width: 765px) 100vw, 765px\" \/><figcaption class=\"wp-element-caption\">Figure 1: One shot prompting: quantitative input data for the prompt (image from the paper).<\/figcaption><\/figure>\n\n\n\n<p>After telling it to assume the role of a financial analyst, \ud835\udc02\ud835\udc21\ud835\udc1a\ud835\udc22\ud835\udc27-\ud835\udc28\ud835\udc1f-\ud835\udc13\ud835\udc21\ud835\udc28\ud835\udc2e\ud835\udc20\ud835\udc21\ud835\udc2d (CoT) techniques guided the LLM towards its answers. The LLM was asked to:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>Identify notable changes in the financial statements.<\/li>\n\n\n\n<li>Compute financial ratios, by first stating the formulae, then computing the ratios.<\/li>\n\n\n\n<li>Provide economic interpretations of the computed ratios<\/li>\n\n\n\n<li>Predict the directional change of future earnings and provide the rationale for that prediction.<\/li>\n<\/ol>\n\n\n\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" width=\"1024\" height=\"630\" src=\"https:\/\/wsw-int.de\/wp-content\/uploads\/2024\/05\/Screenshot-2024-05-30-123244-1024x630.png\" alt=\"\" class=\"wp-image-181\" srcset=\"https:\/\/multai.eu\/wp-content\/uploads\/2024\/05\/Screenshot-2024-05-30-123244-1024x630.png 1024w, https:\/\/multai.eu\/wp-content\/uploads\/2024\/05\/Screenshot-2024-05-30-123244-300x185.png 300w, https:\/\/multai.eu\/wp-content\/uploads\/2024\/05\/Screenshot-2024-05-30-123244-768x473.png 768w, https:\/\/multai.eu\/wp-content\/uploads\/2024\/05\/Screenshot-2024-05-30-123244.png 1453w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\">Figure 2: The LLM&#8217;s answer (image from the paper).<\/figcaption><\/figure>\n\n\n\n<p>The authors found that the LLM, with CoT, easily outperformed the median financial analyst. Even though the LLM was only given quantitative material, it benefited from its general &#8216;understanding&#8217; of the world, including business and investment know-how, combined with an emerging form of intuitive reasoning and a capacity to formulate hypotheses. Moreover, human financial analysts suffer from statistical bias, in all likelihood more so than LLMs in this specific, quantitative use case.<br><br>The authors also trained a three-layer artificial neural network (ANN) on a vast body of data. This \ud835\udc2d\ud835\udc1a\ud835\udc2c\ud835\udc24-\ud835\udc2c\ud835\udc29\ud835\udc1e\ud835\udc1c\ud835\udc22\ud835\udc1f\ud835\udc22\ud835\udc1c \ud835\udc00\ud835\udc0d\ud835\udc0d just matched the general-purpose LLM&#8217;s accuracy. A remarkable result, considering that an \ud835\udc28\ud835\udc1f\ud835\udc1f-\ud835\udc2d\ud835\udc21\ud835\udc1e-\ud835\udc2c\ud835\udc21\ud835\udc1e\ud835\udc25\ud835\udc1f \ud835\udc20\ud835\udc1e\ud835\udc27\ud835\udc1e\ud835\udc2b\ud835\udc1a\ud835\udc25-\ud835\udc29\ud835\udc2e\ud835\udc2b\ud835\udc29\ud835\udc28\ud835\udc2c\ud835\udc1e \ud835\udc0b\ud835\udc0b\ud835\udc0c without any further fine-tuning was used.<br><br>Overall, FSA is an interesting use case demonstrating the numerical skills and emerging reasoning capabilities of general-purpose LLMs. I&#8217;d like to see the results of this study when the LLM was fine-tuned with the data fed into the ANN&#8230;<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">2. Specialized foundation models<\/h2>\n\n\n\n<p>Above, I showed research demonstrating how a language model, basically pre-trained to perform next-word prediction, was capable of accomplishing \ud835\udc27\ud835\udc2e\ud835\udc26\ud835\udc1e\ud835\udc2b\ud835\udc22\ud835\udc1c\ud835\udc1a\ud835\udc25 \ud835\udc2d\ud835\udc1a\ud835\udc2c\ud835\udc24\ud835\udc2c and some related reasoning.<\/p>\n\n\n\n<p>Recently, a new breed of specialized foundation models has emerged. \ud835\udc13\ud835\udc22\ud835\udc26\ud835\udc1e\ud835\udc06\ud835\udc0f\ud835\udc13 is such a model \ud835\udc2c\ud835\udc29\ud835\udc1e\ud835\udc1c\ud835\udc22\ud835\udc1a\ud835\udc25\ud835\udc22\ud835\udc33\ud835\udc1e\ud835\udc1d \ud835\udc22\ud835\udc27 \ud835\udc2d\ud835\udc22\ud835\udc26\ud835\udc1e \ud835\udc2c\ud835\udc1e\ud835\udc2b\ud835\udc22\ud835\udc1e\ud835\udc2c: It is pre-trained on over 100 billion rows of financial, weather, Internet of Things (IoT), energy, and web data.<\/p>\n\n\n\n<p>In their latest <a href=\"https:\/\/arxiv.org\/pdf\/2405.18913\">paper<\/a>, my LIRIS colleagues tested <a href=\"https:\/\/arxiv.org\/abs\/2310.03589\">TimeGPT<\/a> for soil water potential prediction for orchards. As data gathering in agriculture is often expensive, the relative \ud835\udc2c\ud835\udc21\ud835\udc28\ud835\udc2b\ud835\udc2d\ud835\udc1a\ud835\udc20\ud835\udc1e \ud835\udc28\ud835\udc1f \ud835\udc1d\ud835\udc1a\ud835\udc2d\ud835\udc1a often precludes data-hungry deep learning methods such as LSTMs.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" width=\"699\" height=\"1006\" src=\"https:\/\/wsw-int.de\/wp-content\/uploads\/2024\/05\/Screenshot-2024-05-31-213247.png\" alt=\"\" class=\"wp-image-178\" srcset=\"https:\/\/multai.eu\/wp-content\/uploads\/2024\/05\/Screenshot-2024-05-31-213247.png 699w, https:\/\/multai.eu\/wp-content\/uploads\/2024\/05\/Screenshot-2024-05-31-213247-208x300.png 208w\" sizes=\"(max-width: 699px) 100vw, 699px\" \/><figcaption class=\"wp-element-caption\">Figure 3: TimeGPT architecture (image from the paper). Notice how a CNN replaces the Feed Forward layers from the original GPT architecture.<\/figcaption><\/figure>\n\n\n\n<p>They find that, with minor fine-tuning using the target variable&#8217;s (soil water potential) history only, TimeGPT delivers respectable results, only losing out against the state-of-the-art Temporal Fusion Transformer (TFT) model. Note that the TFT model also included exogenous variables such as weather data in its dataset. Considering its \ud835\udc2c\ud835\udc2e\ud835\udc29\ud835\udc1e\ud835\udc2b\ud835\udc22\ud835\udc28\ud835\udc2b \ud835\udc1e\ud835\udc1a\ud835\udc2c\ud835\udc1e \ud835\udc28\ud835\udc1f \ud835\udc2e\ud835\udc2c\ud835\udc1e \ud835\udc22\ud835\udc27 \ud835\udc2d\ud835\udc1e\ud835\udc2b\ud835\udc26\ud835\udc2c \ud835\udc28\ud835\udc1f \ud835\udc1e\ud835\udc1f\ud835\udc1f\ud835\udc28\ud835\udc2b\ud835\udc2d \ud835\udc1a\ud835\udc27\ud835\udc1d \ud835\udc1d\ud835\udc1a\ud835\udc2d\ud835\udc1a, TimeGPT can therefore be considered a serious alternative for use cases plagued by data scarcity. TimeGPT and other such specialized foundation models can leverage their learned skills, such as time series forecasting, to address new problems where training data are not sufficiently available for alternative deep learning methods that require training from scratch.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"931\" height=\"516\" src=\"https:\/\/wsw-int.de\/wp-content\/uploads\/2024\/05\/Screenshot-2024-05-31-213328.png\" alt=\"\" class=\"wp-image-179\" srcset=\"https:\/\/multai.eu\/wp-content\/uploads\/2024\/05\/Screenshot-2024-05-31-213328.png 931w, https:\/\/multai.eu\/wp-content\/uploads\/2024\/05\/Screenshot-2024-05-31-213328-300x166.png 300w, https:\/\/multai.eu\/wp-content\/uploads\/2024\/05\/Screenshot-2024-05-31-213328-768x426.png 768w\" sizes=\"(max-width: 931px) 100vw, 931px\" \/><figcaption class=\"wp-element-caption\">Figure 4: Conventional versus foundation models (image from the paper).<\/figcaption><\/figure>\n\n\n\n<p>Try this out yourself! <strong><a href=\"http:\/\/multai.eu\">MultAI.eu<\/a><\/strong> offers safe and easy access to OpenAI&#8217;s, Google&#8217;s, Anthropic&#8217;s, and others&#8217; models.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>1. Language models By now, we all know that large language models (LLMs) are very capable in qualitative and language-based tasks. The jury is still out, however, concerning their \ud835\udc2b\ud835\udc1e\ud835\udc1a\ud835\udc2c\ud835\udc28\ud835\udc27\ud835\udc22\ud835\udc27\ud835\udc20 \ud835\udc1a\ud835\udc27\ud835\udc1d \ud835\udc27\ud835\udc2e\ud835\udc26\ud835\udc1e\ud835\udc2b\ud835\udc22\ud835\udc1c\ud835\udc1a\ud835\udc25 skills. Researchers at the University of Chicago&#8217;s Booth School of Business (my alma mater) used \ud835\udc05\ud835\udc22\ud835\udc27\ud835\udc1a\ud835\udc27\ud835\udc1c\ud835\udc22\ud835\udc1a\ud835\udc25 \ud835\udc12\ud835\udc2d\ud835\udc1a\ud835\udc2d\ud835\udc1e\ud835\udc26\ud835\udc1e\ud835\udc27\ud835\udc2d \ud835\udc00\ud835\udc27\ud835\udc1a\ud835\udc25\ud835\udc32\ud835\udc2c\ud835\udc22\ud835\udc2c (FSA) to test LLMs\u2019 ability [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-177","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v22.5 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Foundation Models for Numerical Tasks - MultAI<\/title>\n<meta name=\"description\" content=\"Language foundation models are getting good at numerical tasks and reasoning. Specialized foundation models are now also making inroads at specialized tasks such time series forecasting for use case with scarce training data.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/multai.eu\/en_gb\/foundation-models-for-numerical-tasks\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Foundation Models for Numerical Tasks - MultAI\" \/>\n<meta property=\"og:description\" content=\"Language foundation models are getting good at numerical tasks and reasoning. Specialized foundation models are now also making inroads at specialized tasks such time series forecasting for use case with scarce training data.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/multai.eu\/en_gb\/foundation-models-for-numerical-tasks\/\" \/>\n<meta property=\"og:site_name\" content=\"MultAI\" \/>\n<meta property=\"article:published_time\" content=\"2024-05-31T20:00:29+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-10-25T15:27:13+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/wsw-int.de\/wp-content\/uploads\/2024\/05\/Screenshot-2024-05-30-123204-765x1024.png\" \/>\n<meta name=\"author\" content=\"hans\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"hans\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/multai.eu\/foundation-models-for-numerical-tasks\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/multai.eu\/foundation-models-for-numerical-tasks\/\"},\"author\":{\"name\":\"hans\",\"@id\":\"https:\/\/multai.eu\/#\/schema\/person\/06def8c374b5d6724bec911e9880c292\"},\"headline\":\"Foundation Models for Numerical Tasks\",\"datePublished\":\"2024-05-31T20:00:29+00:00\",\"dateModified\":\"2024-10-25T15:27:13+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/multai.eu\/foundation-models-for-numerical-tasks\/\"},\"wordCount\":576,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/multai.eu\/#organization\"},\"image\":{\"@id\":\"https:\/\/multai.eu\/foundation-models-for-numerical-tasks\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/wsw-int.de\/wp-content\/uploads\/2024\/05\/Screenshot-2024-05-30-123204-765x1024.png\",\"articleSection\":[\"Uncategorized\"],\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/multai.eu\/foundation-models-for-numerical-tasks\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/multai.eu\/foundation-models-for-numerical-tasks\/\",\"url\":\"https:\/\/multai.eu\/foundation-models-for-numerical-tasks\/\",\"name\":\"Foundation Models for Numerical Tasks - MultAI\",\"isPartOf\":{\"@id\":\"https:\/\/multai.eu\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/multai.eu\/foundation-models-for-numerical-tasks\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/multai.eu\/foundation-models-for-numerical-tasks\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/wsw-int.de\/wp-content\/uploads\/2024\/05\/Screenshot-2024-05-30-123204-765x1024.png\",\"datePublished\":\"2024-05-31T20:00:29+00:00\",\"dateModified\":\"2024-10-25T15:27:13+00:00\",\"description\":\"Language foundation models are getting good at numerical tasks and reasoning. Specialized foundation models are now also making inroads at specialized tasks such time series forecasting for use case with scarce training data.\",\"breadcrumb\":{\"@id\":\"https:\/\/multai.eu\/foundation-models-for-numerical-tasks\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/multai.eu\/foundation-models-for-numerical-tasks\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/multai.eu\/foundation-models-for-numerical-tasks\/#primaryimage\",\"url\":\"https:\/\/wsw-int.de\/wp-content\/uploads\/2024\/05\/Screenshot-2024-05-30-123204-765x1024.png\",\"contentUrl\":\"https:\/\/wsw-int.de\/wp-content\/uploads\/2024\/05\/Screenshot-2024-05-30-123204-765x1024.png\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/multai.eu\/foundation-models-for-numerical-tasks\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/multai.eu\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Foundation Models for Numerical Tasks\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/multai.eu\/#website\",\"url\":\"https:\/\/multai.eu\/\",\"name\":\"WSW\",\"description\":\"Generative AI for your business\",\"publisher\":{\"@id\":\"https:\/\/multai.eu\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/multai.eu\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/multai.eu\/#organization\",\"name\":\"WSW\",\"alternateName\":\"MultAI\",\"url\":\"https:\/\/multai.eu\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/multai.eu\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/multai.eu\/wp-content\/uploads\/2024\/10\/Logo.png\",\"contentUrl\":\"https:\/\/multai.eu\/wp-content\/uploads\/2024\/10\/Logo.png\",\"width\":225,\"height\":244,\"caption\":\"WSW\"},\"image\":{\"@id\":\"https:\/\/multai.eu\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/multai.eu\/#\/schema\/person\/06def8c374b5d6724bec911e9880c292\",\"name\":\"hans\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/multai.eu\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/1409f6643b6f17d5838709af9deca41643884a95390f8a4f8ea478b9187aec41?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/1409f6643b6f17d5838709af9deca41643884a95390f8a4f8ea478b9187aec41?s=96&d=mm&r=g\",\"caption\":\"hans\"},\"sameAs\":[\"https:\/\/wsw-int.de\"],\"url\":\"https:\/\/multai.eu\/en_gb\/author\/hans\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Foundation Models for Numerical Tasks - MultAI","description":"Language foundation models are getting good at numerical tasks and reasoning. Specialized foundation models are now also making inroads at specialized tasks such time series forecasting for use case with scarce training data.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/multai.eu\/en_gb\/foundation-models-for-numerical-tasks\/","og_locale":"en_GB","og_type":"article","og_title":"Foundation Models for Numerical Tasks - MultAI","og_description":"Language foundation models are getting good at numerical tasks and reasoning. Specialized foundation models are now also making inroads at specialized tasks such time series forecasting for use case with scarce training data.","og_url":"https:\/\/multai.eu\/en_gb\/foundation-models-for-numerical-tasks\/","og_site_name":"MultAI","article_published_time":"2024-05-31T20:00:29+00:00","article_modified_time":"2024-10-25T15:27:13+00:00","og_image":[{"url":"https:\/\/wsw-int.de\/wp-content\/uploads\/2024\/05\/Screenshot-2024-05-30-123204-765x1024.png"}],"author":"hans","twitter_card":"summary_large_image","twitter_misc":{"Written by":"hans","Estimated reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/multai.eu\/foundation-models-for-numerical-tasks\/#article","isPartOf":{"@id":"https:\/\/multai.eu\/foundation-models-for-numerical-tasks\/"},"author":{"name":"hans","@id":"https:\/\/multai.eu\/#\/schema\/person\/06def8c374b5d6724bec911e9880c292"},"headline":"Foundation Models for Numerical Tasks","datePublished":"2024-05-31T20:00:29+00:00","dateModified":"2024-10-25T15:27:13+00:00","mainEntityOfPage":{"@id":"https:\/\/multai.eu\/foundation-models-for-numerical-tasks\/"},"wordCount":576,"commentCount":0,"publisher":{"@id":"https:\/\/multai.eu\/#organization"},"image":{"@id":"https:\/\/multai.eu\/foundation-models-for-numerical-tasks\/#primaryimage"},"thumbnailUrl":"https:\/\/wsw-int.de\/wp-content\/uploads\/2024\/05\/Screenshot-2024-05-30-123204-765x1024.png","articleSection":["Uncategorized"],"inLanguage":"en-GB","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/multai.eu\/foundation-models-for-numerical-tasks\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/multai.eu\/foundation-models-for-numerical-tasks\/","url":"https:\/\/multai.eu\/foundation-models-for-numerical-tasks\/","name":"Foundation Models for Numerical Tasks - MultAI","isPartOf":{"@id":"https:\/\/multai.eu\/#website"},"primaryImageOfPage":{"@id":"https:\/\/multai.eu\/foundation-models-for-numerical-tasks\/#primaryimage"},"image":{"@id":"https:\/\/multai.eu\/foundation-models-for-numerical-tasks\/#primaryimage"},"thumbnailUrl":"https:\/\/wsw-int.de\/wp-content\/uploads\/2024\/05\/Screenshot-2024-05-30-123204-765x1024.png","datePublished":"2024-05-31T20:00:29+00:00","dateModified":"2024-10-25T15:27:13+00:00","description":"Language foundation models are getting good at numerical tasks and reasoning. Specialized foundation models are now also making inroads at specialized tasks such time series forecasting for use case with scarce training data.","breadcrumb":{"@id":"https:\/\/multai.eu\/foundation-models-for-numerical-tasks\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/multai.eu\/foundation-models-for-numerical-tasks\/"]}]},{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/multai.eu\/foundation-models-for-numerical-tasks\/#primaryimage","url":"https:\/\/wsw-int.de\/wp-content\/uploads\/2024\/05\/Screenshot-2024-05-30-123204-765x1024.png","contentUrl":"https:\/\/wsw-int.de\/wp-content\/uploads\/2024\/05\/Screenshot-2024-05-30-123204-765x1024.png"},{"@type":"BreadcrumbList","@id":"https:\/\/multai.eu\/foundation-models-for-numerical-tasks\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/multai.eu\/"},{"@type":"ListItem","position":2,"name":"Foundation Models for Numerical Tasks"}]},{"@type":"WebSite","@id":"https:\/\/multai.eu\/#website","url":"https:\/\/multai.eu\/","name":"WSW","description":"Generative AI for your business","publisher":{"@id":"https:\/\/multai.eu\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/multai.eu\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-GB"},{"@type":"Organization","@id":"https:\/\/multai.eu\/#organization","name":"WSW","alternateName":"MultAI","url":"https:\/\/multai.eu\/","logo":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/multai.eu\/#\/schema\/logo\/image\/","url":"https:\/\/multai.eu\/wp-content\/uploads\/2024\/10\/Logo.png","contentUrl":"https:\/\/multai.eu\/wp-content\/uploads\/2024\/10\/Logo.png","width":225,"height":244,"caption":"WSW"},"image":{"@id":"https:\/\/multai.eu\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/multai.eu\/#\/schema\/person\/06def8c374b5d6724bec911e9880c292","name":"hans","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/multai.eu\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/1409f6643b6f17d5838709af9deca41643884a95390f8a4f8ea478b9187aec41?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/1409f6643b6f17d5838709af9deca41643884a95390f8a4f8ea478b9187aec41?s=96&d=mm&r=g","caption":"hans"},"sameAs":["https:\/\/wsw-int.de"],"url":"https:\/\/multai.eu\/en_gb\/author\/hans\/"}]}},"_links":{"self":[{"href":"https:\/\/multai.eu\/en_gb\/wp-json\/wp\/v2\/posts\/177","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/multai.eu\/en_gb\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/multai.eu\/en_gb\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/multai.eu\/en_gb\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/multai.eu\/en_gb\/wp-json\/wp\/v2\/comments?post=177"}],"version-history":[{"count":3,"href":"https:\/\/multai.eu\/en_gb\/wp-json\/wp\/v2\/posts\/177\/revisions"}],"predecessor-version":[{"id":1439,"href":"https:\/\/multai.eu\/en_gb\/wp-json\/wp\/v2\/posts\/177\/revisions\/1439"}],"wp:attachment":[{"href":"https:\/\/multai.eu\/en_gb\/wp-json\/wp\/v2\/media?parent=177"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/multai.eu\/en_gb\/wp-json\/wp\/v2\/categories?post=177"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/multai.eu\/en_gb\/wp-json\/wp\/v2\/tags?post=177"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}