{"id":16614,"date":"2026-10-26T12:53:50","date_gmt":"2026-10-26T11:53:50","guid":{"rendered":"https:\/\/www.iese.fraunhofer.de\/blog\/?p=16614"},"modified":"2026-10-26T12:53:52","modified_gmt":"2026-10-26T11:53:52","slug":"llm-as-a-judge-agentic-software-engineering","status":"publish","type":"post","link":"https:\/\/www.iese.fraunhofer.de\/blog\/llm-as-a-judge-agentic-software-engineering\/","title":{"rendered":"Causal AI for Agentic Software Engineering: Evaluating LLM as a Judge"},"content":{"rendered":"\n<div class=\"wp-block-group alignfull has-global-padding is-layout-constrained wp-block-group-is-layout-constrained\">\n<div class=\"wp-block-group has-global-padding is-layout-constrained wp-block-group-is-layout-constrained\" style=\"margin-bottom:var(--wp--preset--spacing--medium)\">\n<p class=\"wp-block-paragraph\" style=\"font-size:clamp(14.642px, 0.915rem + ((1vw - 3.2px) * 0.783), 22px);font-style:normal;font-weight:500\"><strong>Who judges the judge?<\/strong>\u00a0The use of an\u00a0LLM as a judge\u00a0is becoming increasingly relevant for evaluating software artifacts. But how reliably do their assessments agree with those of human experts? Using causal inference, we investigated how code complexity, model size, question wording, and temperature relate to the agreement between seven Qwen models and human experts in assessments of 304 Java classes.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-text-color has-secondary-1-color has-alpha-channel-opacity has-secondary-1-background-color has-background is-style-wide\"\/>\n<\/div>\n\n\n\n<div class=\"wp-block-group has-global-padding is-layout-constrained wp-container-core-group-is-layout-2f5b0d04 wp-block-group-is-layout-constrained\">\n<div class=\"wp-block-group has-border-color has-neutral-1-border-color has-base-background-color has-background has-global-padding is-layout-constrained wp-container-core-group-is-layout-8a34b12a wp-block-group-is-layout-constrained\" style=\"border-width:1px;margin-top:0;padding-top:var(--wp--preset--spacing--small);padding-right:var(--wp--preset--spacing--small);padding-bottom:var(--wp--preset--spacing--small);padding-left:var(--wp--preset--spacing--small)\">\n<h2 class=\"wp-block-heading has-text-align-left\">Key findings at a glance<\/h2>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Code complexity matters:<\/strong>\u00a0More complex code showed lower agreement between the tested LLMs and human expert ratings<strong>.<\/strong><\/li>\n\n\n\n<li><strong>Larger models were not consistently more reliable:<\/strong>\u00a0Among the tested Qwen models, agreement did not improve monotonically with parameter count.<\/li>\n\n\n\n<li><strong>Temperature showed no detectable effect within the tested range:<\/strong>\u00a0We found no statistically detectable effect on agreement.<\/li>\n<\/ul>\n<\/div>\n<\/div>\n\n\n\n<h2 class=\"wp-block-heading\">LLM-as-a-Judge in Software Engineering<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Large language models are already producing a growing share of the software artifacts we rely on: specifications, test plans, code, documentation. As we reflected a year ago in <a href=\"https:\/\/www.iese.fraunhofer.de\/blog\/generative-ai-in-se-and-ai-orchestrated-sdlc-retrospective\/\" target=\"_blank\" rel=\"noopener\">our retrospective on AI-orchestrated SDLC<\/a>, the central question is no longer whether AI can produce an artifact, but how we validate the artifacts that AI produces.<\/p>\n\n\n\n<div class=\"wp-block-group has-global-padding is-layout-constrained wp-container-core-group-is-layout-2f5b0d04 wp-block-group-is-layout-constrained\">\n<div class=\"wp-block-columns has-base-color has-gradient-1-gradient-background has-text-color has-background has-link-color wp-elements-1 is-layout-flex wp-container-core-columns-is-layout-3454470e wp-block-columns-is-layout-flex\" style=\"padding-top:var(--wp--preset--spacing--small);padding-right:var(--wp--preset--spacing--small);padding-bottom:var(--wp--preset--spacing--small);padding-left:var(--wp--preset--spacing--small)\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:50px\">\n<p class=\"has-material-symbols-outlined-font-family has-max-48-font-size wp-container-content-b04ba3db wp-block-paragraph\" style=\"line-height:1\">\n        info      <\/p>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<h3 class=\"wp-block-heading has-text-align-left is-style-no-gradient has-base-color has-text-color has-link-color has-large-font-size wp-elements-2 is-style-no-gradient--1\">What is LLM as a Judge?<\/h3>\n\n\n\n<p class=\"has-text-align-left has-large-font-size wp-block-paragraph\" style=\"line-height:1.5\">LLM as a Judge refers to the use of a large language model to evaluate an artifact according to predefined criteria. In agentic software engineering, it can be used to assess artifacts such as specifications, user stories, test plans, code, and documentation. Before organizations rely on such assessments, they need to understand when and under which conditions they agree with human experts.<\/p>\n<\/div>\n<\/div>\n<\/div>\n\n\n\n<p class=\"wp-block-paragraph\">Software product quality is commonly organized around the ISO\/IEC 25010 standard, which breaks it down into characteristics such as functional suitability, performance efficiency, security, and maintainability. Some of these can be assessed using rule-based methods\u2014for example, functional suitability through test suites or security through scanners that detect known vulnerabilities. However, even for maintainability, static analysis provides only proxies, such as complexity or coupling, that correlate with quality rather than measuring it directly. Other aspects require an understanding of meaning and context.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">For such aspects, human expert review remains the reference, but it is costly and does not scale to the volume of artifacts that AI now produces. LLM as a Judge offers a scalable alternative by providing the semantic and contextual understanding that rule-based metrics lack. The approach is already in use: agentic coding frameworks can make agents evaluate their own outputs against explicit criteria, while dedicated review agents assess artifacts such as code or user stories (see our blog article on <a href=\"https:\/\/www.iese.fraunhofer.de\/blog\/agentic-skillsets-change-software-engineering\/\">skillsets<\/a>).<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Empirical Challenges<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Knowing which factors make a judge more reliable requires separating their individual contributions. The cleanest way is a controlled experiment: vary one factor at a time while holding everything else constant. But for a substantial part of the relevant factors, no such control is possible: the properties of the code under evaluation, the project it comes from, and the human experts&#8216; judgments are not free variables. These can only be observed, and they vary together, so that no comparison isolates the contribution of a single factor.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Even a single factor is hard to measure. The complexity of code is usually reduced to simple counters, such as the number of lines or functions, but that is not the same as how hard the code feels to a human. And the human judgment that is compared against is not a fixed target: different experts do not always agree, and datasets in which several experts judge the same code are rare.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Some influences are also invisible: who wrote the code, how long it has existed, or what it is used for can shape both the code and the experts&#8216; opinions without leaving a trace in the data. No comparison can remove an influence that is not visible. For such factors, only observational data remain.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Causal Inference for Software Engineering<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Causal inference provides a framework for drawing causal conclusions from observational data, in exactly the situations where a controlled experiment is not possible. Its central move is to make the causal assumptions explicit before the data is analyzed, and to represent them as a causal graph (a directed acyclic graph): a link between two variables stands for a possible direct causal effect, and the absence of a link stands for the assumption that no such effect exists.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">From this graph it can be derived how the data must be analyzed in order to separate causal effects from mere correlations. The method behind this is the do-calculus, and it yields a second, often more valuable answer: which effects cannot be estimated from the data at hand at all. The advantage of the approach is twofold. The causal assumptions stay explicit and can be checked against the data, and the analysis method is derived from the assumptions rather than chosen after the fact.<\/p>\n\n\n\n<div class=\"wp-block-group has-global-padding is-layout-constrained wp-container-core-group-is-layout-2f5b0d04 wp-block-group-is-layout-constrained\">\n<div class=\"wp-block-group has-border-color has-neutral-1-border-color has-base-background-color has-background has-global-padding is-layout-constrained wp-container-core-group-is-layout-8a34b12a wp-block-group-is-layout-constrained\" style=\"border-width:1px;margin-top:0;padding-top:var(--wp--preset--spacing--small);padding-right:var(--wp--preset--spacing--small);padding-bottom:var(--wp--preset--spacing--small);padding-left:var(--wp--preset--spacing--small)\">\n<p class=\"has-secondary-1-color has-text-color has-link-color has-material-symbols-outlined-font-family has-max-36-font-size wp-elements-3 wp-block-paragraph\">\n      trending_up    <\/p>\n\n\n\n<h3 class=\"wp-block-heading has-text-align-left\">Causal inference<\/h3>\n\n\n\n<p class=\"has-text-align-left wp-block-paragraph\" style=\"line-height:1.5\">Other blog posts on the topic of causal inference for software engineering:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li><a href=\"https:\/\/www.iese.fraunhofer.de\/blog\/causal-inference\/\" target=\"_blank\" rel=\"noreferrer noopener\">Causal inference: An introduction on how to separate causal effects from spurious correlations in data<\/a>.<\/li>\n\n\n\n<li><a href=\"https:\/\/www.iese.fraunhofer.de\/blog\/datenqualitaet-machine-learning\/\">Datenqualit\u00e4t und Kausalit\u00e4t bei auf Machine Learning basierender Software (German)<\/a><\/li>\n<\/ol>\n<\/div>\n<\/div>\n\n\n\n<p class=\"wp-block-paragraph\">Causal inference is a well-established tool in statistics and the social sciences, but only a relatively recent addition to software engineering. Early applications appeared in the 2010s [2,3], and only in the last two years has the work begun to consolidate into a field, <em>Causal Software Engineering<\/em>, with several tutorials [5,6], and a vision and roadmap [4] and a dedicated special issue [7].<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">LLM-as-a-Judge for software maintainability<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">In our recent work, we applied causal inference techniques to investigate agreement between assessments made by LLM judges and human experts. [1]. We used a public dataset [8] as our reference, in which several human experts independently rated 304 Java classes from five projects (ArgoUML, AOI, Diary Management, JSweet and JUnit 4) on five aspects: readability, understandability, complexity, modularity and overall maintainability.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We evaluated seven judge models from the Qwen 3.5 family, ranging from 0.8 billion to approximately 400 billion parameters and spanning both dense and mixture-of-experts architectures. Each model was tasked with answering the same five questions as the human experts. Their answers were then compared with those of the experts.<\/p>\n\n\n\n<figure data-wp-context=\"{&quot;imageId&quot;:&quot;6ae0c724a7da0&quot;}\" data-wp-interactive=\"core\/image\" data-wp-key=\"6ae0c724a7da0\" class=\"wp-block-image size-large wp-lightbox-container\"><img loading=\"lazy\" decoding=\"async\" width=\"698\" height=\"234\" data-wp-class--hide=\"state.isContentHidden\" data-wp-class--show=\"state.isContentVisible\" data-wp-init=\"callbacks.setButtonStyles\" data-wp-on--click=\"actions.showLightbox\" data-wp-on--load=\"callbacks.setButtonStyles\" data-wp-on--pointerdown=\"actions.preloadImage\" data-wp-on--pointerenter=\"actions.preloadImageWithDelay\" data-wp-on--pointerleave=\"actions.cancelPreload\" data-wp-on-window--resize=\"callbacks.setButtonStyles\" src=\"https:\/\/www.iese.fraunhofer.de\/blog\/wp-content\/uploads\/2026\/10\/llm-as-a-judge-causal-graph-fraunhofer-iese-698x234.png\" alt=\"Causal graph showing how artifact properties, human properties, model properties, the human evaluation template, and the judge model prompt are assumed to influence human ratings, model answers, and their agreement.\" class=\"wp-image-17312\" srcset=\"https:\/\/www.iese.fraunhofer.de\/blog\/wp-content\/uploads\/2026\/10\/llm-as-a-judge-causal-graph-fraunhofer-iese-698x234.png 698w, https:\/\/www.iese.fraunhofer.de\/blog\/wp-content\/uploads\/2026\/10\/llm-as-a-judge-causal-graph-fraunhofer-iese-400x134.png 400w, https:\/\/www.iese.fraunhofer.de\/blog\/wp-content\/uploads\/2026\/10\/llm-as-a-judge-causal-graph-fraunhofer-iese-768x257.png 768w, https:\/\/www.iese.fraunhofer.de\/blog\/wp-content\/uploads\/2026\/10\/llm-as-a-judge-causal-graph-fraunhofer-iese-1536x514.png 1536w, https:\/\/www.iese.fraunhofer.de\/blog\/wp-content\/uploads\/2026\/10\/llm-as-a-judge-causal-graph-fraunhofer-iese-2048x685.png 2048w\" sizes=\"auto, (max-width: 698px) 100vw, 698px\" \/><button\n\t\t\tclass=\"lightbox-trigger\"\n\t\t\ttype=\"button\"\n\t\t\taria-haspopup=\"dialog\"\n\t\t\tdata-wp-bind--aria-label=\"state.thisImage.triggerButtonAriaLabel\"\n\t\t\tdata-wp-init=\"callbacks.initTriggerButton\"\n\t\t\tdata-wp-on--click=\"actions.showLightbox\"\n\t\t\tdata-wp-style--right=\"state.thisImage.buttonRight\"\n\t\t\tdata-wp-style--top=\"state.thisImage.buttonTop\"\n\t\t>\n\t\t\t<svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"12\" height=\"12\" fill=\"none\" viewBox=\"0 0 12 12\">\n\t\t\t\t<path fill=\"#fff\" d=\"M2 0a2 2 0 0 0-2 2v2h1.5V2a.5.5 0 0 1 .5-.5h2V0H2Zm2 10.5H2a.5.5 0 0 1-.5-.5V8H0v2a2 2 0 0 0 2 2h2v-1.5ZM8 12v-1.5h2a.5.5 0 0 0 .5-.5V8H12v2a2 2 0 0 1-2 2H8Zm2-12a2 2 0 0 1 2 2v2h-1.5V2a.5.5 0 0 0-.5-.5H8V0h2Z\" \/>\n\t\t\t<\/svg>\n\t\t<\/button><figcaption class=\"wp-element-caption\"><sup>High-level causal model of the factors assumed to influence agreement between LLM and human assessments. Arrows represent assumed causal directions, not relationships established by the data alone. GT: Ground Truth; MA: Model Answer; AG: Agreement.<\/sup><\/figcaption><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">Findings<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Complexity is the enemy of agreement.<\/strong> The most practically important factor is the complexity of the code. Controlling for project and code size, code complexity drastically reduces agreement with human experts.  On simple code the judge and the human largely see the same thing; on complex code the judge starts to actively disagree, not just waver. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Bigger is not (monotonically) better.<\/strong> Holding architecture and quantization constant, model size does not follow the &#8222;bigger is better&#8220; intuition: the 9B model outperforms the 4B model, yet the 35B model outperforms the 122B model. Parameter count alone does not explain agreement quality. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Question formulation matters.<\/strong> How a quality criterion is phrased is a real lever: readability and understandability questions yield more aligned judgments than modularity and overall-maintainability questions. The framing of a question is a design parameter on par with the model choice. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Temperature has no effect.<\/strong> Sampling temperature (0.6 versus 1.0) has no significant effect on any agreement measure. <\/p>\n\n\n\n<h2 class=\"wp-block-heading\">What this means for practice<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Four takeaways for teams that already use LLMs to review, score, or self-check generated artifacts: <\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Do not assume the biggest model is the best judge. Model-size effects on judge quality are non-monotonic. When choosing or upgrading a judge, candidates should be benchmarked on the organization&#8217;s own artifacts and criteria, under constant architecture and quantization.<\/li>\n\n\n\n<li>Route complex artifacts to humans, or break them up. Judge reliability degrades sharply with the complexity of the code under evaluation, and degrades in a directional way (the judge starts to disagree, not just waver). A pragmatic design is to use the judge for first-pass screening of simple artifacts and escalate the rest.<\/li>\n\n\n\n<li>Treat question formulation as part of the system. How a quality question is phrased changes agreement with human experts. Rubrics are not interchangeable; they are a design parameter on par with the model choice.<\/li>\n\n\n\n<li>Design evaluations like causal experiments. Before running an expensive benchmark, it pays to check which effects the design can actually identify. This step can save months of misinterpreted correlations and it shows exactly which new experiments are needed (e.g., posing every question in both its positive and negative form).<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">Next steps<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">The evaluation in [1] is a first step on a specific task and a specific kind of judge; the detailed limitations are documented in the paper. Two directions stand out for what comes next.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Breadth. <\/strong>The same causal approach can be applied to other quality aspects and to other artifact types beyond the maintainability of Java classes, for example functional suitability, security, and the specifications, test plans, and documentation that agentic pipelines produce.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Realism. <\/strong>The current evaluation is a controlled study on a curated dataset, and the goal is to apply the method in real settings, in particular inside an agentic AI coding assistant, where an LLM-as-a-Judge runs continuously in the loop of actual development. Such settings are precisely where a controlled experiment is impossible: the artifacts, the code, and the expert judgments are observed, not controlled. That is exactly where causal inference applies. Even without the ability to vary a factor at will, it remains possible to estimate and reason about causal effects, provided the causal assumptions are explicit and can be checked against the data.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The promise of LLM-as-a-Judge is a scalable quality gate for the flood of AI-generated artifacts. Causal reasoning can make such judges not just usable, but <em>understandable<\/em>, so that when a judge diverges from human experts, the reason is known and a remedy can be applied.<\/p>\n\n\n\n<div class=\"wp-block-group has-neutral-2-background-color has-background is-layout-flow wp-block-group-is-layout-flow\">\n<div class=\"wp-block-group has-gradient-1-gradient-background has-background is-layout-flow wp-block-group-is-layout-flow\" style=\"border-style:none;border-width:0px;border-radius:2px;margin-top:0;padding-top:4px;padding-right:4px;padding-bottom:4px;padding-left:4px\">\n<div class=\"wp-block-group has-base-background-color has-background has-global-padding is-layout-constrained wp-container-core-group-is-layout-38a0f662 wp-block-group-is-layout-constrained\" style=\"padding-top:var(--wp--preset--spacing--small);padding-right:var(--wp--preset--spacing--small);padding-bottom:var(--wp--preset--spacing--small);padding-left:var(--wp--preset--spacing--small)\">\n<h2 class=\"wp-block-heading has-text-align-center is-style-no-gradient has-x-large-font-size is-style-no-gradient--2\">Explore the LLM-as-a-Judge paper<\/h2>\n\n\n\n<p class=\"has-text-align-center wp-block-paragraph\" style=\"line-height:1.5\"><br>Read the full paper for details on the study design, causal inference approach, and findings. Have questions about the research or its application to software quality? Get in touch with the author.<\/p>\n\n\n\n<div class=\"wp-block-buttons is-content-justification-center is-layout-flex wp-container-core-buttons-is-layout-d61d70aa wp-block-buttons-is-layout-flex\">\n<div class=\"wp-block-button\"><a class=\"wp-block-button__link has-small-font-size has-custom-font-size wp-element-button\" href=\"https:\/\/openreview.net\/attachment?id=Rcgr7WPr7T&amp;name=pdf\" style=\"padding-top:var(--wp--preset--spacing--x-small);padding-right:var(--wp--preset--spacing--medium);padding-bottom:var(--wp--preset--spacing--x-small);padding-left:var(--wp--preset--spacing--medium)\" target=\"_blank\" rel=\"noopener\">Read the full paper<\/a><\/div>\n\n\n\n<div class=\"wp-block-button is-style-outline is-style-outline--3\"><a class=\"wp-block-button__link has-small-font-size has-custom-font-size wp-element-button\" href=\"mailto:julien.siebert@iese.fraunhofer.de;anfrage@iese.fraunhofer.de\" style=\"padding-top:var(--wp--preset--spacing--x-small);padding-right:var(--wp--preset--spacing--medium);padding-bottom:var(--wp--preset--spacing--x-small);padding-left:var(--wp--preset--spacing--medium)\">Contact the author<\/a><\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n\n\n\n<h3 class=\"wp-block-heading\">References<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>[1] Siebert, J. LLM-as-a-Judge for assessing maintainability. First results with a causal approach. In <em>Workshop on application of artificial intelligence for software engineering<\/em>. KI2026 \u2013 49th German Conference on Artificial Intelligence <a href=\"https:\/\/openreview.net\/forum?id=Rcgr7WPr7T\">https:\/\/openreview.net\/forum?id=Rcgr7WPr7T<\/a><\/li>\n\n\n\n<li>[2] Siebert, J. (2023). Applications of statistical causal inference in software engineering. <em>Information and Software Technology<\/em>, <em>159<\/em>, 107198.<\/li>\n\n\n\n<li>[3] Giamattei, L., Guerriero, A., Pietrantuono, R., &amp; Russo, S. (2025). Causal reasoning in Software Quality Assurance: A systematic review. <em>Information and Software Technology<\/em>, <em>178<\/em>, 107599.<\/li>\n\n\n\n<li>[4] Pietrantuono, R., Giamattei, L., Russo, S., Siebert, J., &amp; Walkinshaw, N. (2026, July). Causal Software Engineering: A Vision and Roadmap. In <em>Proceedings of the 34th ACM International Conference on the Foundations of Software Engineering<\/em> (pp. 1346-1350).<\/li>\n\n\n\n<li>[5] Siebert, J., Frattini, J., Heyn, H. M., &amp; Pietrantuono, R. (2026, July). Introduction to Causal Inference for Software Engineering. In <em>Proceedings of the 34th ACM International Conference on the Foundations of Software Engineering<\/em> (pp. 52-53).<\/li>\n\n\n\n<li>[6] Frattini, J., Heyn, H. M., Feldt, R., &amp; Torkar, R. (2025). Tutorial Debriefing: Applied Statistical Causal Inference in Requirements Engineering. <em>arXiv preprint arXiv:2511.03875<\/em>.<\/li>\n\n\n\n<li>[7] Siebert, J., Trendowicz, A., G\u00f6ssler, G., Washizaki, H., Kl\u00e4s, M., &amp; Shepperd, M. (2025). Special issue on causal modeling and inference in SE. <em>Information and Software Technology<\/em>, <em>183<\/em>, 107754.<\/li>\n\n\n\n<li>[8] Schnappinger, M., Fietzke, A., &amp; Pretschner, A. (2020, September). Defining a software maintainability dataset: collecting, aggregating and analysing expert evaluations of software maintainability. In <em>2020 IEEE International Conference on Software Maintenance and Evolution (ICSME)<\/em> (pp. 278-289). IEEE.<br><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Who judges the judge?\u00a0The use of an\u00a0LLM as a judge\u00a0is becoming increasingly relevant for evaluating software artifacts. But how reliably do their assessments agree with those of human experts? Using causal inference, we investigated how code complexity, model size, question wording, and temperature relate to the agreement between seven Qwen models and human experts in [&hellip;]<\/p>\n","protected":false},"author":66,"featured_media":16666,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"featured_image_credits_title":"\u00a9 Fraunhofer IESE | KI-generated","featured_image_credits_url":"","featured_image_credits_position":"bottom-right","featured_image_credits_shadow":"-1px -1px 0 rgba(0,0,0,0.25),0 -1px 0 rgba(0,0,0,0.25),1px -1px 0 rgba(0,0,0,0.25),1px 0 0 rgba(0,0,0,0.25),1px 1px 0 rgba(0,0,0,0.25),0 1px 0 rgba(0,0,0,0.25),-1px 1px 0 rgba(0,0,0,0.25),-1px 0 0 rgba(0,0,0,0.25)","footnotes":""},"categories":[177,7],"tags":[938,941,415,198,587,53],"coauthors":[214],"class_list":["post-16614","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-kuenstliche-intelligenz","category-all","tag-agentic-ai","tag-causal-inference","tag-dependable-ai-verlaessliche-ki","tag-english","tag-large-language-models-llm","tag-qualitaetssicherung"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.8 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Causal AI for Agentic Software Engineering: Evaluating LLM as a Judge - Blog des Fraunhofer IESE<\/title>\n<meta name=\"description\" content=\"How reliably can LLM-as-a-Judge assess software quality? A causal study examines seven Qwen models, human experts, and 304 Java classes.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.iese.fraunhofer.de\/blog\/llm-as-a-judge-agentic-software-engineering\/\" \/>\n<meta property=\"og:locale\" content=\"de_DE\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Causal AI for Agentic Software Engineering: Evaluating LLM as a Judge - Blog des Fraunhofer IESE\" \/>\n<meta property=\"og:description\" content=\"How reliably can LLM-as-a-Judge assess software quality? A causal study examines seven Qwen models, human experts, and 304 Java classes.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.iese.fraunhofer.de\/blog\/llm-as-a-judge-agentic-software-engineering\/\" \/>\n<meta property=\"og:site_name\" content=\"Fraunhofer IESE\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/FraunhoferIESE\/\" \/>\n<meta property=\"article:published_time\" content=\"2026-10-26T11:53:50+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-10-26T11:53:52+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.iese.fraunhofer.de\/blog\/wp-content\/uploads\/2026\/08\/image_20260828_192547-e1793014969392.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"683\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Dr. Julien Siebert\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@FraunhoferIESE\" \/>\n<meta name=\"twitter:site\" content=\"@FraunhoferIESE\" \/>\n<meta name=\"twitter:label1\" content=\"Verfasst von\" \/>\n\t<meta name=\"twitter:data1\" content=\"Dr. Julien Siebert\" \/>\n\t<meta name=\"twitter:label2\" content=\"Gesch\u00e4tzte Lesezeit\" \/>\n\t<meta name=\"twitter:data2\" content=\"9\u00a0Minuten\" \/>\n\t<meta name=\"twitter:label3\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data3\" content=\"Dr. Julien Siebert\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.iese.fraunhofer.de\\\/blog\\\/llm-as-a-judge-agentic-software-engineering\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.iese.fraunhofer.de\\\/blog\\\/llm-as-a-judge-agentic-software-engineering\\\/\"},\"author\":{\"name\":\"Dr. Julien Siebert\",\"@id\":\"https:\\\/\\\/www.iese.fraunhofer.de\\\/blog\\\/#\\\/schema\\\/person\\\/96d3d2ce62a13a8ee470ea948601ff28\"},\"headline\":\"Causal AI for Agentic Software Engineering: Evaluating LLM as a Judge\",\"datePublished\":\"2026-10-26T11:53:50+00:00\",\"dateModified\":\"2026-10-26T11:53:52+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.iese.fraunhofer.de\\\/blog\\\/llm-as-a-judge-agentic-software-engineering\\\/\"},\"wordCount\":1895,\"publisher\":{\"@id\":\"https:\\\/\\\/www.iese.fraunhofer.de\\\/blog\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/www.iese.fraunhofer.de\\\/blog\\\/llm-as-a-judge-agentic-software-engineering\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.iese.fraunhofer.de\\\/blog\\\/wp-content\\\/uploads\\\/2026\\\/08\\\/image_20260828_192547-e1793014969392.png\",\"keywords\":[\"Agentic AI\",\"Causal Inference\",\"Dependable AI \\\/ Verl\u00e4ssliche KI\",\"English\",\"Large Language Models (LLM)\",\"Qualit\u00e4tssicherung\"],\"articleSection\":[\"K\u00fcnstliche Intelligenz\",\"Software Engineering\"],\"inLanguage\":\"de\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.iese.fraunhofer.de\\\/blog\\\/llm-as-a-judge-agentic-software-engineering\\\/\",\"url\":\"https:\\\/\\\/www.iese.fraunhofer.de\\\/blog\\\/llm-as-a-judge-agentic-software-engineering\\\/\",\"name\":\"Causal AI for Agentic Software Engineering: Evaluating LLM as a Judge - Blog des Fraunhofer IESE\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.iese.fraunhofer.de\\\/blog\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.iese.fraunhofer.de\\\/blog\\\/llm-as-a-judge-agentic-software-engineering\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.iese.fraunhofer.de\\\/blog\\\/llm-as-a-judge-agentic-software-engineering\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.iese.fraunhofer.de\\\/blog\\\/wp-content\\\/uploads\\\/2026\\\/08\\\/image_20260828_192547-e1793014969392.png\",\"datePublished\":\"2026-10-26T11:53:50+00:00\",\"dateModified\":\"2026-10-26T11:53:52+00:00\",\"description\":\"How reliably can LLM-as-a-Judge assess software quality? A causal study examines seven Qwen models, human experts, and 304 Java classes.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.iese.fraunhofer.de\\\/blog\\\/llm-as-a-judge-agentic-software-engineering\\\/#breadcrumb\"},\"inLanguage\":\"de\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.iese.fraunhofer.de\\\/blog\\\/llm-as-a-judge-agentic-software-engineering\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"de\",\"@id\":\"https:\\\/\\\/www.iese.fraunhofer.de\\\/blog\\\/llm-as-a-judge-agentic-software-engineering\\\/#primaryimage\",\"url\":\"https:\\\/\\\/www.iese.fraunhofer.de\\\/blog\\\/wp-content\\\/uploads\\\/2026\\\/08\\\/image_20260828_192547-e1793014969392.png\",\"contentUrl\":\"https:\\\/\\\/www.iese.fraunhofer.de\\\/blog\\\/wp-content\\\/uploads\\\/2026\\\/08\\\/image_20260828_192547-e1793014969392.png\",\"width\":1024,\"height\":683,\"caption\":\"LLM-as-a-Judge illustrated by a gavel, scales, a reviewed document, and connected data points\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.iese.fraunhofer.de\\\/blog\\\/llm-as-a-judge-agentic-software-engineering\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Startseite\",\"item\":\"https:\\\/\\\/www.iese.fraunhofer.de\\\/blog\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Causal AI for Agentic Software Engineering: Evaluating LLM as a Judge\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.iese.fraunhofer.de\\\/blog\\\/#website\",\"url\":\"https:\\\/\\\/www.iese.fraunhofer.de\\\/blog\\\/\",\"name\":\"Fraunhofer IESE\",\"description\":\"Blog des Fraunhofer-Institut f\u00fcr Experimentelles Software Engineering\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.iese.fraunhofer.de\\\/blog\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.iese.fraunhofer.de\\\/blog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"de\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.iese.fraunhofer.de\\\/blog\\\/#organization\",\"name\":\"Fraunhofer IESE\",\"url\":\"https:\\\/\\\/www.iese.fraunhofer.de\\\/blog\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"de\",\"@id\":\"https:\\\/\\\/www.iese.fraunhofer.de\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/www.iese.fraunhofer.de\\\/blog\\\/wp-content\\\/uploads\\\/2016\\\/08\\\/fhg_iese_logo.png\",\"contentUrl\":\"https:\\\/\\\/www.iese.fraunhofer.de\\\/blog\\\/wp-content\\\/uploads\\\/2016\\\/08\\\/fhg_iese_logo.png\",\"width\":183,\"height\":50,\"caption\":\"Fraunhofer IESE\"},\"image\":{\"@id\":\"https:\\\/\\\/www.iese.fraunhofer.de\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/FraunhoferIESE\\\/\",\"https:\\\/\\\/x.com\\\/FraunhoferIESE\",\"https:\\\/\\\/www.linkedin.com\\\/company\\\/fraunhoferiese\\\/\",\"https:\\\/\\\/www.youtube.com\\\/c\\\/FraunhoferIESE\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.iese.fraunhofer.de\\\/blog\\\/#\\\/schema\\\/person\\\/96d3d2ce62a13a8ee470ea948601ff28\",\"name\":\"Dr. Julien Siebert\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"de\",\"@id\":\"https:\\\/\\\/www.iese.fraunhofer.de\\\/blog\\\/wp-content\\\/uploads\\\/2020\\\/10\\\/siebert_julien_8513_blog-96x96.jpg299e210bdf5631c16552ac66c10e3e56\",\"url\":\"https:\\\/\\\/www.iese.fraunhofer.de\\\/blog\\\/wp-content\\\/uploads\\\/2020\\\/10\\\/siebert_julien_8513_blog-96x96.jpg\",\"contentUrl\":\"https:\\\/\\\/www.iese.fraunhofer.de\\\/blog\\\/wp-content\\\/uploads\\\/2020\\\/10\\\/siebert_julien_8513_blog-96x96.jpg\",\"caption\":\"Dr. Julien Siebert\"},\"description\":\"Julien Siebert is working as senior AI Expert in the Data Science department of Fraunhofer IESE. He studied Artificial Intelligence and Engineering Science and got his PhD in Computer Science on the topic of agent based software for multiagent multi-modeling and co-simulation. His professional interests include scientifc process, artificial intelligence and complex systems.\",\"sameAs\":[\"https:\\\/\\\/www.linkedin.com\\\/in\\\/dr-siebert-julien\\\/\",\"https:\\\/\\\/sites.google.com\\\/view\\\/dr-julien-siebert\\\/\"],\"url\":\"https:\\\/\\\/www.iese.fraunhofer.de\\\/blog\\\/author\\\/julien-siebert\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Causal AI for Agentic Software Engineering: Evaluating LLM as a Judge - Blog des Fraunhofer IESE","description":"How reliably can LLM-as-a-Judge assess software quality? A causal study examines seven Qwen models, human experts, and 304 Java classes.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.iese.fraunhofer.de\/blog\/llm-as-a-judge-agentic-software-engineering\/","og_locale":"de_DE","og_type":"article","og_title":"Causal AI for Agentic Software Engineering: Evaluating LLM as a Judge - Blog des Fraunhofer IESE","og_description":"How reliably can LLM-as-a-Judge assess software quality? A causal study examines seven Qwen models, human experts, and 304 Java classes.","og_url":"https:\/\/www.iese.fraunhofer.de\/blog\/llm-as-a-judge-agentic-software-engineering\/","og_site_name":"Fraunhofer IESE","article_publisher":"https:\/\/www.facebook.com\/FraunhoferIESE\/","article_published_time":"2026-10-26T11:53:50+00:00","article_modified_time":"2026-10-26T11:53:52+00:00","og_image":[{"width":1024,"height":683,"url":"https:\/\/www.iese.fraunhofer.de\/blog\/wp-content\/uploads\/2026\/08\/image_20260828_192547-e1793014969392.png","type":"image\/png"}],"author":"Dr. Julien Siebert","twitter_card":"summary_large_image","twitter_creator":"@FraunhoferIESE","twitter_site":"@FraunhoferIESE","twitter_misc":{"Verfasst von":"Dr. Julien Siebert","Gesch\u00e4tzte Lesezeit":"9\u00a0Minuten","Written by":"Dr. Julien Siebert"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.iese.fraunhofer.de\/blog\/llm-as-a-judge-agentic-software-engineering\/#article","isPartOf":{"@id":"https:\/\/www.iese.fraunhofer.de\/blog\/llm-as-a-judge-agentic-software-engineering\/"},"author":{"name":"Dr. Julien Siebert","@id":"https:\/\/www.iese.fraunhofer.de\/blog\/#\/schema\/person\/96d3d2ce62a13a8ee470ea948601ff28"},"headline":"Causal AI for Agentic Software Engineering: Evaluating LLM as a Judge","datePublished":"2026-10-26T11:53:50+00:00","dateModified":"2026-10-26T11:53:52+00:00","mainEntityOfPage":{"@id":"https:\/\/www.iese.fraunhofer.de\/blog\/llm-as-a-judge-agentic-software-engineering\/"},"wordCount":1895,"publisher":{"@id":"https:\/\/www.iese.fraunhofer.de\/blog\/#organization"},"image":{"@id":"https:\/\/www.iese.fraunhofer.de\/blog\/llm-as-a-judge-agentic-software-engineering\/#primaryimage"},"thumbnailUrl":"https:\/\/www.iese.fraunhofer.de\/blog\/wp-content\/uploads\/2026\/08\/image_20260828_192547-e1793014969392.png","keywords":["Agentic AI","Causal Inference","Dependable AI \/ Verl\u00e4ssliche KI","English","Large Language Models (LLM)","Qualit\u00e4tssicherung"],"articleSection":["K\u00fcnstliche Intelligenz","Software Engineering"],"inLanguage":"de"},{"@type":"WebPage","@id":"https:\/\/www.iese.fraunhofer.de\/blog\/llm-as-a-judge-agentic-software-engineering\/","url":"https:\/\/www.iese.fraunhofer.de\/blog\/llm-as-a-judge-agentic-software-engineering\/","name":"Causal AI for Agentic Software Engineering: Evaluating LLM as a Judge - Blog des Fraunhofer IESE","isPartOf":{"@id":"https:\/\/www.iese.fraunhofer.de\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.iese.fraunhofer.de\/blog\/llm-as-a-judge-agentic-software-engineering\/#primaryimage"},"image":{"@id":"https:\/\/www.iese.fraunhofer.de\/blog\/llm-as-a-judge-agentic-software-engineering\/#primaryimage"},"thumbnailUrl":"https:\/\/www.iese.fraunhofer.de\/blog\/wp-content\/uploads\/2026\/08\/image_20260828_192547-e1793014969392.png","datePublished":"2026-10-26T11:53:50+00:00","dateModified":"2026-10-26T11:53:52+00:00","description":"How reliably can LLM-as-a-Judge assess software quality? A causal study examines seven Qwen models, human experts, and 304 Java classes.","breadcrumb":{"@id":"https:\/\/www.iese.fraunhofer.de\/blog\/llm-as-a-judge-agentic-software-engineering\/#breadcrumb"},"inLanguage":"de","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.iese.fraunhofer.de\/blog\/llm-as-a-judge-agentic-software-engineering\/"]}]},{"@type":"ImageObject","inLanguage":"de","@id":"https:\/\/www.iese.fraunhofer.de\/blog\/llm-as-a-judge-agentic-software-engineering\/#primaryimage","url":"https:\/\/www.iese.fraunhofer.de\/blog\/wp-content\/uploads\/2026\/08\/image_20260828_192547-e1793014969392.png","contentUrl":"https:\/\/www.iese.fraunhofer.de\/blog\/wp-content\/uploads\/2026\/08\/image_20260828_192547-e1793014969392.png","width":1024,"height":683,"caption":"LLM-as-a-Judge illustrated by a gavel, scales, a reviewed document, and connected data points"},{"@type":"BreadcrumbList","@id":"https:\/\/www.iese.fraunhofer.de\/blog\/llm-as-a-judge-agentic-software-engineering\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Startseite","item":"https:\/\/www.iese.fraunhofer.de\/blog\/"},{"@type":"ListItem","position":2,"name":"Causal AI for Agentic Software Engineering: Evaluating LLM as a Judge"}]},{"@type":"WebSite","@id":"https:\/\/www.iese.fraunhofer.de\/blog\/#website","url":"https:\/\/www.iese.fraunhofer.de\/blog\/","name":"Fraunhofer IESE","description":"Blog des Fraunhofer-Institut f\u00fcr Experimentelles Software Engineering","publisher":{"@id":"https:\/\/www.iese.fraunhofer.de\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.iese.fraunhofer.de\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"de"},{"@type":"Organization","@id":"https:\/\/www.iese.fraunhofer.de\/blog\/#organization","name":"Fraunhofer IESE","url":"https:\/\/www.iese.fraunhofer.de\/blog\/","logo":{"@type":"ImageObject","inLanguage":"de","@id":"https:\/\/www.iese.fraunhofer.de\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.iese.fraunhofer.de\/blog\/wp-content\/uploads\/2016\/08\/fhg_iese_logo.png","contentUrl":"https:\/\/www.iese.fraunhofer.de\/blog\/wp-content\/uploads\/2016\/08\/fhg_iese_logo.png","width":183,"height":50,"caption":"Fraunhofer IESE"},"image":{"@id":"https:\/\/www.iese.fraunhofer.de\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/FraunhoferIESE\/","https:\/\/x.com\/FraunhoferIESE","https:\/\/www.linkedin.com\/company\/fraunhoferiese\/","https:\/\/www.youtube.com\/c\/FraunhoferIESE"]},{"@type":"Person","@id":"https:\/\/www.iese.fraunhofer.de\/blog\/#\/schema\/person\/96d3d2ce62a13a8ee470ea948601ff28","name":"Dr. Julien Siebert","image":{"@type":"ImageObject","inLanguage":"de","@id":"https:\/\/www.iese.fraunhofer.de\/blog\/wp-content\/uploads\/2020\/10\/siebert_julien_8513_blog-96x96.jpg299e210bdf5631c16552ac66c10e3e56","url":"https:\/\/www.iese.fraunhofer.de\/blog\/wp-content\/uploads\/2020\/10\/siebert_julien_8513_blog-96x96.jpg","contentUrl":"https:\/\/www.iese.fraunhofer.de\/blog\/wp-content\/uploads\/2020\/10\/siebert_julien_8513_blog-96x96.jpg","caption":"Dr. Julien Siebert"},"description":"Julien Siebert is working as senior AI Expert in the Data Science department of Fraunhofer IESE. He studied Artificial Intelligence and Engineering Science and got his PhD in Computer Science on the topic of agent based software for multiagent multi-modeling and co-simulation. His professional interests include scientifc process, artificial intelligence and complex systems.","sameAs":["https:\/\/www.linkedin.com\/in\/dr-siebert-julien\/","https:\/\/sites.google.com\/view\/dr-julien-siebert\/"],"url":"https:\/\/www.iese.fraunhofer.de\/blog\/author\/julien-siebert\/"}]}},"_links":{"self":[{"href":"https:\/\/www.iese.fraunhofer.de\/blog\/wp-json\/wp\/v2\/posts\/16614","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.iese.fraunhofer.de\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.iese.fraunhofer.de\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.iese.fraunhofer.de\/blog\/wp-json\/wp\/v2\/users\/66"}],"replies":[{"embeddable":true,"href":"https:\/\/www.iese.fraunhofer.de\/blog\/wp-json\/wp\/v2\/comments?post=16614"}],"version-history":[{"count":30,"href":"https:\/\/www.iese.fraunhofer.de\/blog\/wp-json\/wp\/v2\/posts\/16614\/revisions"}],"predecessor-version":[{"id":17315,"href":"https:\/\/www.iese.fraunhofer.de\/blog\/wp-json\/wp\/v2\/posts\/16614\/revisions\/17315"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.iese.fraunhofer.de\/blog\/wp-json\/wp\/v2\/media\/16666"}],"wp:attachment":[{"href":"https:\/\/www.iese.fraunhofer.de\/blog\/wp-json\/wp\/v2\/media?parent=16614"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.iese.fraunhofer.de\/blog\/wp-json\/wp\/v2\/categories?post=16614"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.iese.fraunhofer.de\/blog\/wp-json\/wp\/v2\/tags?post=16614"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.iese.fraunhofer.de\/blog\/wp-json\/wp\/v2\/coauthors?post=16614"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}