d3rlpy.models.q_functions.IQNQFunctionFactory¶
-
class
d3rlpy.models.q_functions.
IQNQFunctionFactory
(n_quantiles=64, n_greedy_quantiles=32, embed_size=64)[source]¶ Implicit Quantile Network Q function factory class.
References
- Parameters
n_quantiles – the number of quantiles.
n_greedy_quantiles – the number of quantiles for inference.
embed_size – the embedding size.
Methods
-
create_continuous
(encoder)[source]¶ Returns PyTorch’s Q function module.
- Parameters
encoder (d3rlpy.models.torch.encoders.EncoderWithAction) – an encoder module that processes the observation and action to obtain feature representations.
- Returns
continuous Q function object.
- Return type
d3rlpy.models.torch.q_functions.ContinuousIQNQFunction
-
create_discrete
(encoder, action_size)[source]¶ Returns PyTorch’s Q function module.
- Parameters
encoder (d3rlpy.models.torch.encoders.Encoder) – an encoder module that processes the observation to obtain feature representations.
action_size (int) – dimension of discrete action-space.
- Returns
discrete Q function object.
- Return type
d3rlpy.models.torch.q_functions.DiscreteIQNQFunction
Attributes
-
embed_size
¶
-
n_greedy_quantiles
¶
-
n_quantiles
¶