Statistics of Activated Neurons running error

[srn-source]

Hello, thank you for amazing work.
i am curious that i follow readme part to run Activated Neurons but i got error
i clone transformer and copy modeling_bloom to you new code. and install -e . i got error

python infer_activate.py
TypeError: BloomForCausalLM.init() got an unexpected keyword argument 'activate_file'

How to solve it?

[takagi97]

Hi, sorry for the very late reply — we only just saw this issue.

To clarify, activate_file is a file path used to record neuron activation states during model inference.

You can modify the code directly in modeling_bloom.py:

• At [line 858](https://github.com/takagi97/LLMs-are-parallel-multilingual-learners/blob/main/counting_activated_neurons/modeling/modeling_bloom.py#L858), hardcode self.activate_file to an absolute path to your desired .jsonl file.
• At line 850, you can remove activate_file as a hyperparameter entirely.

Feel free to reach out again if you run into any further issues — happy to help!