Skip to content

Conversation

@sfc-gh-jkew
Copy link
Contributor

@sfc-gh-jkew sfc-gh-jkew commented May 1, 2025

In both the caster and the calculator we emit some new metrics to track the switching behavior. This will be used by a metrics handler to implement debugging tools.

  • first commit message and PR title follow format outlined here

    NOTE: If you edit the PR title to match this format, you need to add another commit (even if it's empty) or amend your last commit for the CI job that checks the PR title to pick up the new PR title.

  • passes flake8 modin/ asv_bench/benchmarks scripts/doc_checker.py
  • passes black --check modin/ asv_bench/benchmarks scripts/doc_checker.py
  • signed commit with git commit -s
  • Resolves Emit metrics on auto-switch and casting behavior #7549
  • tests added and passing
  • module layout described at docs/development/architecture.rst is up-to-date

@sfc-gh-jkew sfc-gh-jkew marked this pull request as ready for review May 1, 2025 20:43
@sfc-gh-jkew sfc-gh-jkew marked this pull request as draft May 2, 2025 21:19
@sfc-gh-jkew sfc-gh-jkew marked this pull request as ready for review May 7, 2025 21:38
@sfc-gh-jkew sfc-gh-jkew requested a review from sfc-gh-joshi May 10, 2025 00:40
sfc-gh-jkew added a commit to snowflakedb/snowpark-python that referenced this pull request May 10, 2025
f"BackendCostCalculator Results: {self._calc_result_log(self._result_backend)}"
)
# Does not need to be secure, should not use system entropy
metrics_group = "%04x" % random.randrange(16**4)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This was originally a monotonic counter, right? Why is it random now?

@sfc-gh-joshi sfc-gh-joshi force-pushed the jkew/emit-hybrid-metrics branch from 9fcc377 to 1ed78a2 Compare May 22, 2025 18:52
Copy link
Contributor

@sfc-gh-mvashishtha sfc-gh-mvashishtha left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have one question about testing.

@sfc-gh-joshi sfc-gh-joshi merged commit 0d2f4bc into main May 23, 2025
79 checks passed
sfc-gh-joshi pushed a commit to snowflakedb/snowpark-python that referenced this pull request May 23, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Emit metrics on auto-switch and casting behavior

6 participants