simcop2387/AutoGPTQ
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages 1 Wiki Activity

Merge pull request #310 from PanQiWei/fix_to()_metod_bug

Browse source 
fix model type changed after calling .to() method
This commit is contained in:
潘其威(William) 2023-08-31 19:04:02 +08:00 • committed by GitHub
commit 1e938e6bad
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 2 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

3
auto_gptq/modeling/_base.py
View file

@ -433,7 +433,8 @@ class BaseGPTQForCausalLM(nn.Module, PushToHubMixin):
return torch.device(device) return torch.device(device)
def to(self, device: Union[str, torch.device]): def to(self, device: Union[str, torch.device]):
return self.model.to(device) self.model.to(device)
return self
def forward(self, *args, **kwargs): def forward(self, *args, **kwargs):
return self.model(*args, **kwargs) return self.model(*args, **kwargs)