-
Notifications
You must be signed in to change notification settings - Fork 461
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[LTC] Adopt more LazyGraphExecutor virtual interfaces #4314
Conversation
6e229d9
to
825f929
Compare
coll->unlocker.size() > 0) { | ||
return; | ||
} | ||
torch::lazy::LazyGraphExecutor::TensorCollectionBarrier(coll); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
hmm so the reason we need to overwrite this function is for future SPMD use case?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yea, or I can add the todo to the upstream. 😂
@@ -956,8 +924,7 @@ XLAGraphExecutor::PostOrderData XLAGraphExecutor::RunPostOrder( | |||
} | |||
|
|||
XLAGraphExecutor::ComputationCache::TypePtr | |||
XLAGraphExecutor::LookupCachedCompile(const std::vector<XLATensorPtr>& tensors, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
haha, I guess at some point we dropped the use of tensors
without noticing it.
Thanks Jack for approving. |
825f929
to
7d2301e
Compare
Summary: This patch makes the following interfaces virtual for XLA to adopt: 1. LazyGraphExecutor::Async. 2. TensorCollectionBarrier 3. SyncLiveTensorsGraph It's related to pytorch/xla#4314. Test Plan: CI. Pull Request resolved: #90650 Approved by: https://github.com/wconstab
This reverts commit 7d2301e.
Summary:
This patch tries to adopt even more LazyGraphExecutor virtual interfaces:
And comments on methods that we don't adopt.
This depends on pytorch/pytorch#90650.
Test Plan:
CI.