INNER CODE UNIT · Python

nb_path

Future-House/BixBench · bixbench/generate_trajectories.py:313

        nb_path = work_dir / self.config.notebook.name

        # Add some extra metadata from config
        question["avoid_images"] = self.config.capsule.avoid_images
        question["include_refusal_option"] = self.config.capsule.include_refusal_option

        env_args = {
            "problem_id": question["question_id"],
            "problem": problem,
            "eval_mode": self.config.capsule.eval_mode,
            "nb_path": nb_path,
            "work_dir": work_dir,
            "language": self.config.notebook.language,
            "system_prompt": self.config.system_prompt,
            "metadata": question,
            "answer": answer,
            "use_tmp_work_dir": False,
        }

View source record →

📰 Research Paper
Loading…
⏳ Fetching content…