peft.IntDense

peft.IntDense#

class gemma.peft.IntDense(
*,
wrapped: flax.linen.linear.Dense,
dtype: numpy.dtype = <class 'jax.numpy.int4'>,
parent: flax.linen.module.Module | flax.core.scope.Scope | flax.linen.module._Sentinel | None = <flax.linen.module._Sentinel object>,
name: str | None = None,
)[源代码]

基类: flax.linen.module.Module

围绕 nn.Dense 的包装器,它添加了一个量化适配器。

wrapped: flax.linen.linear.Dense
dtype

别名: jax.numpy.int4

name: str | None = None
parent: flax.linen.module.Module | flax.core.scope.Scope | flax.linen.module._Sentinel | None = None
scope: Scope | None = None