d3rlpy.q_functions.QRQFunctionFactory

class d3rlpy.q_functions.QRQFunctionFactory(n_quantiles=200)

Quantile Regression Q function factory class.

References

• Dabney et al., Distributional reinforcement learning with quantile regression.

Parameters:n_quantiles (int) – the number of quantiles.

n_quantiles

the number of quantiles.

Type:int

Methods

create(encoder, action_size=None)

Returns PyTorch’s Q function module.

Parameters:

• encoder (torch.nn.Module) – an encoder module that processes the observation (and action in continuous action-space) to obtain feature representations.
• action_size (int) – dimension of discrete action-space. If the action-space is continous, None will be passed.

Returns:

Q function object.

Return type:

torch.nn.Module

get_params(deep=False)

Returns Q function parameters.

Returns:Q function parameters. Return type:dict

get_type()

Returns Q function type.

Returns:Q function type. Return type:str

Attributes

TYPE = 'qr'