{"id":39,"date":"2025-10-20T16:45:15","date_gmt":"2025-10-20T16:45:15","guid":{"rendered":"https:\/\/ykim.synology.me\/wordpress\/?p=39"},"modified":"2025-12-23T16:40:33","modified_gmt":"2025-12-23T22:40:33","slug":"hierarchy-of-llm-reasoning-techniques","status":"publish","type":"post","link":"https:\/\/ykim.synology.me\/wordpress\/hierarchy-of-llm-reasoning-techniques-39\/","title":{"rendered":"Hierarchy of LLM Reasoning Techniques"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\">Hierarchy of LLM Reasoning Techniques<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">This outlines how these prompting methods generally relate, building from the simplest approach:<\/p>\n\n\n\n<ol start=\"1\" class=\"wp-block-list\">\n<li><strong>Standard Prompting<\/strong> (Baseline)\n<ul class=\"wp-block-list\">\n<li><strong>Description:<\/strong> Asks for a direct answer without requesting intermediate steps.<\/li>\n\n\n\n<li><strong>Process:<\/strong> <code>Input -&gt; Output<\/code><\/li>\n<\/ul>\n<\/li>\n<\/ol>\n\n\n\n<ol start=\"2\" class=\"wp-block-list\">\n<li><strong>Chain of Thought (CoT) Prompting<\/strong> (Foundational Step-by-Step Reasoning) [1]\n<ul class=\"wp-block-list\">\n<li><strong>Description:<\/strong> Elicits a <em>single, linear<\/em> sequence of reasoning steps (text-based) before providing the final answer. Improves accuracy on complex tasks by breaking them down.<\/li>\n\n\n\n<li><strong>Process:<\/strong> <code>Input -&gt; Step 1 -&gt; Step 2 -&gt; ... -&gt; Output<\/code><\/li>\n\n\n\n<li><strong>Sub-types:<\/strong>\n<ul class=\"wp-block-list\">\n<li><strong>Zero-Shot CoT:<\/strong> Uses a trigger phrase like &#8220;Let&#8217;s think step by step&#8221; without examples [5].<\/li>\n\n\n\n<li><strong>Few-Shot CoT:<\/strong> Provides examples of step-by-step reasoning within the prompt [6].<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<\/ol>\n\n\n\n<ol start=\"3\" class=\"wp-block-list\">\n<li><strong>Domain-Specific Adaptations of CoT<\/strong>\n<ul class=\"wp-block-list\">\n<li><strong>Description:<\/strong> Applies the step-by-step reasoning concept to specific data types or structures.<\/li>\n\n\n\n<li><strong>Chain of Table (CoTbl):<\/strong> Adapts CoT specifically for <em>structured tabular data<\/em>. Reasoning steps involve generating and applying <em>table operations<\/em> (like filter, group by, sort) iteratively, producing intermediate tables [2, 7].\n<ul class=\"wp-block-list\">\n<li><strong>Process:<\/strong> <code>Input (Query + Table_0) -&gt; Operation_1 -&gt; Table_1 -&gt; Operation_2 -&gt; Table_2 -&gt; ... -&gt; Output<\/code><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<\/ol>\n\n\n\n<ol start=\"4\" class=\"wp-block-list\">\n<li><strong>Enhancements &amp; Generalizations of CoT<\/strong>\n<ul class=\"wp-block-list\">\n<li><strong>Description:<\/strong> These techniques build upon, modify, or extend the basic CoT structure to improve robustness or handle more complex problems.<\/li>\n\n\n\n<li><strong>Self-Consistency (SC):<\/strong> An <em>ensemble method<\/em> applied <em>on top of CoT<\/em> [3].\n<ul class=\"wp-block-list\">\n<li><strong>Process:<\/strong>\n<ol start=\"1\" class=\"wp-block-list\">\n<li>Generate <em>multiple<\/em> independent CoT reasoning paths for the same input (often using sampling).<\/li>\n\n\n\n<li>Aggregate the final answers from each path.<\/li>\n\n\n\n<li>Select the most frequent answer (majority vote) as the final, more reliable output.<\/li>\n<\/ol>\n<\/li>\n\n\n\n<li><strong>Relationship to CoT:<\/strong> Uses CoT as a base generator but adds a consensus layer for robustness.<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><strong>Tree of Thoughts (ToT):<\/strong> A <em>generalization<\/em> of CoT enabling <em>non-linear, exploratory reasoning<\/em> [4].\n<ul class=\"wp-block-list\">\n<li><strong>Process:<\/strong>\n<ol start=\"1\" class=\"wp-block-list\">\n<li>Generates <em>multiple possible thoughts<\/em> or reasoning steps (branches) at each stage.<\/li>\n\n\n\n<li><em>Evaluates<\/em> the potential of different branches towards reaching the solution.<\/li>\n\n\n\n<li>Uses <em>search algorithms<\/em> (like BFS or DFS) to explore the &#8220;thought tree,&#8221; allowing for strategic planning and <strong>backtracking<\/strong> from unpromising paths.<\/li>\n<\/ol>\n<\/li>\n\n\n\n<li><strong>Relationship to CoT:<\/strong> Extends CoT&#8217;s linear path into a branching structure for complex exploration and decision-making.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<\/ol>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Taxonomy Summary:<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>CoT<\/strong> is the core technique establishing linear, step-by-step textual reasoning.<\/li>\n\n\n\n<li><strong>CoTbl<\/strong> is a specialized version of CoT tailored for structured operations on tables.<\/li>\n\n\n\n<li><strong>SC<\/strong> is an enhancement layer applied over CoT to increase answer reliability through consensus.<\/li>\n\n\n\n<li><strong>ToT<\/strong> is a more complex generalization of CoT, moving from linear chains to branching trees for exploration and strategic problem-solving.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">This hierarchy shows a progression from the simplest form of prompting to increasingly sophisticated methods designed to handle specific data types, improve robustness, or tackle more complex, non-linear problems.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Reference List<\/strong><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">[1] NVIDIA. (n.d.). <em>What is Chain of Thought (CoT) Prompting?<\/em> NVIDIA. Retrieved October 20, 2025, from <a target=\"_blank\" rel=\"noreferrer noopener\" href=\"https:\/\/www.nvidia.com\/en-us\/glossary\/cot-prompting\/\">https:\/\/www.nvidia.com\/en-us\/glossary\/cot-prompting\/<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">[2] Google Research. (2024, March 11). <em>Chain-of-table: Evolving tables in the reasoning chain for table understanding<\/em>. Google Research Blog. Retrieved October 20, 2025, from <a target=\"_blank\" rel=\"noreferrer noopener\" href=\"https:\/\/research.google\/blog\/chain-of-table-evolving-tables-in-the-reasoning-chain-for-table-understanding\/\">https:\/\/research.google\/blog\/chain-of-table-evolving-tables-in-the-reasoning-chain-for-table-understanding\/<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">[3] PromptHub. (n.d.). <em>Self-Consistency and Universal Self-Consistency Prompting<\/em>. Retrieved October 20, 2025, from <a target=\"_blank\" rel=\"noreferrer noopener\" href=\"https:\/\/www.prompthub.us\/blog\/self-consistency-and-universal-self-consistency-prompting\">https:\/\/www.prompthub.us\/blog\/self-consistency-and-universal-self-consistency-prompting<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">[4] Emeritus. (2024, January 22). <em>Tree of Thoughts Prompting; How Does it Enhance AI Results?<\/em> Retrieved October 20, 2025, from <a target=\"_blank\" rel=\"noreferrer noopener\" href=\"https:\/\/emeritus.org\/blog\/tree-of-thoughts-prompting\/\">https:\/\/emeritus.org\/blog\/tree-of-thoughts-prompting\/<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">[5] IBM. (n.d.). <em>What is chain of thought (CoT) prompting?<\/em> IBM. Retrieved October 20, 2025, from <a target=\"_blank\" rel=\"noreferrer noopener\" href=\"https:\/\/www.ibm.com\/think\/topics\/chain-of-thoughts\">https:\/\/www.ibm.com\/think\/topics\/chain-of-thoughts<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">[6] Codecademy. (n.d.). <em>Chain of Thought Prompting Explained (with examples)<\/em>. Retrieved October 20, 2025, from <a target=\"_blank\" rel=\"noreferrer noopener\" href=\"https:\/\/www.codecademy.com\/article\/chain-of-thought-cot-prompting\">https:\/\/www.codecademy.com\/article\/chain-of-thought-cot-prompting<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">[7] Relevance AI. (n.d.). <em>Master Chain-of-Table Prompting for Effective Data Analysis<\/em>. Retrieved October 20, 2025, from <a target=\"_blank\" rel=\"noreferrer noopener\" href=\"https:\/\/relevanceai.com\/prompt-engineering\/master-chain-of-table-prompting-for-effective-data-analysis\">https:\/\/relevanceai.com\/prompt-engineering\/master-chain-of-table-prompting-for-effective-data-analysis<\/a><\/p>\n<div style='text-align:center' class='yasr-auto-insert-overall'><\/div><div style='text-align:center' class='yasr-auto-insert-visitor'><\/div>","protected":false},"excerpt":{"rendered":"<p>Hierarchy of LLM Reasoning Techniques This outlines how these prompting methods generally relate, building from the simplest approach: Taxonomy Summary: This hierarchy shows a progression from the simplest form of prompting to increasingly sophisticated methods designed to handle specific data types, improve robustness, or tackle more complex, non-linear problems. Reference List [1] NVIDIA. (n.d.). What&#8230;<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_bbp_topic_count":0,"_bbp_reply_count":0,"_bbp_total_topic_count":0,"_bbp_total_reply_count":0,"_bbp_voice_count":0,"_bbp_anonymous_reply_count":0,"_bbp_topic_count_hidden":0,"_bbp_reply_count_hidden":0,"_bbp_forum_subforum_count":0,"_kadence_starter_templates_imported_post":false,"_kad_post_transparent":"","_kad_post_title":"","_kad_post_layout":"","_kad_post_sidebar_id":"","_kad_post_content_style":"","_kad_post_vertical_padding":"","_kad_post_feature":"","_kad_post_feature_position":"","_kad_post_header":false,"_kad_post_footer":false,"_kad_post_classname":"","yasr_overall_rating":0,"yasr_post_is_review":"","yasr_auto_insert_disabled":"","yasr_review_type":"","fifu_image_url":"","fifu_image_alt":"","iawp_total_views":0,"footnotes":""},"categories":[10,56],"tags":[],"class_list":["post-39","post","type-post","status-publish","format-standard","hentry","category-software-slug","category-data-science-slug"],"yasr_visitor_votes":{"stars_attributes":{"read_only":false,"span_bottom":false},"number_of_votes":0,"sum_votes":0},"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/ykim.synology.me\/wordpress\/wp-json\/wp\/v2\/posts\/39","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ykim.synology.me\/wordpress\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ykim.synology.me\/wordpress\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ykim.synology.me\/wordpress\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/ykim.synology.me\/wordpress\/wp-json\/wp\/v2\/comments?post=39"}],"version-history":[{"count":3,"href":"https:\/\/ykim.synology.me\/wordpress\/wp-json\/wp\/v2\/posts\/39\/revisions"}],"predecessor-version":[{"id":3597,"href":"https:\/\/ykim.synology.me\/wordpress\/wp-json\/wp\/v2\/posts\/39\/revisions\/3597"}],"wp:attachment":[{"href":"https:\/\/ykim.synology.me\/wordpress\/wp-json\/wp\/v2\/media?parent=39"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ykim.synology.me\/wordpress\/wp-json\/wp\/v2\/categories?post=39"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ykim.synology.me\/wordpress\/wp-json\/wp\/v2\/tags?post=39"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}