File manager - Edit - /usr/lib/rads/venv/lib/python3.13/site-packages/s3transfer/__pycache__/bandwidth.cpython-313.pyc
Back
� � �i�< � � � S SK r S SKr " S S\5 r " S S5 r " S S5 r " S S 5 r " S S 5 r " S S 5 r " S S5 r " S S5 r g)� Nc �( ^ � \ rS rSrU 4S jrSrU =r$ )�RequestExceededException� c �L >� Xl X l SU SU 3n[ TU ] U5 g)a` Error when requested amount exceeds what is allowed The request that raised this error should be retried after waiting the time specified by ``retry_time``. :type requested_amt: int :param requested_amt: The originally requested byte amount :type retry_time: float :param retry_time: The length in time to wait to retry for the requested amount zRequest amount z) exceeded the amount available. Retry in N)� requested_amt� retry_time�super�__init__)�selfr r �msg� __class__s ��G/usr/lib/rads/venv/lib/python3.13/site-packages/s3transfer/bandwidth.pyr �!RequestExceededException.__init__ s2 �� � +��$�� � ��.W�Xb�Wc�d�� ���� � �r r )�__name__� __module__� __qualname__�__firstlineno__r �__static_attributes__� __classcell__)r s @r r r s �� � � r r c � � \ rS rSrSrSrg)� RequestToken�% zDA token to pass as an identifier when consuming from the LeakyBucket� N)r r r r �__doc__r r r r r r % s � �N�r r c � � \ rS rSrS rS rSrg)� TimeUtils�+ c �, � [ R " 5 $ )zOGet the current time back :rtype: float :returns: The current time in seconds )�time�r s r r! �TimeUtils.time, s � � �y�y�{�r c �. � [ R " U5 $ )z_Sleep for a designated time :type value: float :param value: The time to sleep for in seconds )r! �sleep)r �values r r% �TimeUtils.sleep4 s � � �z�z�%� � r r N)r r r r r! r% r r r r r r + s � ��!r r c �* � \ rS rSrSS jr SS jrSrg)�BandwidthLimiter�= Nc �B � Xl X l Uc [ 5 U l gg)z�Limits bandwidth for shared S3 transfers :type leaky_bucket: LeakyBucket :param leaky_bucket: The leaky bucket to use limit bandwidth :type time_utils: TimeUtils :param time_utils: Time utility to use for interacting with time. N)� _leaky_bucket� _time_utilsr )r � leaky_bucket� time_utilss r r �BandwidthLimiter.__init__> s% � � *��%�� � � (�{�D� � r c �t � [ XR X R 5 nU( d UR 5 U$ )a� Wraps a fileobj in a bandwidth limited stream wrapper :type fileobj: file-like obj :param fileobj: The file-like obj to wrap :type transfer_coordinator: s3transfer.futures.TransferCoordinator param transfer_coordinator: The coordinator for the general transfer that the wrapped stream is a part of :type enabled: boolean :param enabled: Whether bandwidth limiting should be enabled to start )�BandwidthLimitedStreamr, r- �disable_bandwidth_limiting)r �fileobj�transfer_coordinator�enabled�streams r �get_bandwith_limited_stream�,BandwidthLimiter.get_bandwith_limited_streamL s6 � � (� �'�'�)=�?O�?O� �� � � -� -� /�� r )r, r- �N)T)r r r r r r8 r r r r r) r) = s � � +� 6:�r r) c �h � \ rS rSr SS jrS rS rS rS rS r S r SS jr S r S r S rS rSrg)r2 �c Nc � � Xl X l X0l X@l Uc [ 5 U l SU l [ 5 U l SU l XPl g)a Limits bandwidth for reads on a wrapped stream :type fileobj: file-like object :param fileobj: The file like object to wrap :type leaky_bucket: LeakyBucket :param leaky_bucket: The leaky bucket to use to throttle reads on the stream :type transfer_coordinator: s3transfer.futures.TransferCoordinator param transfer_coordinator: The coordinator for the general transfer that the wrapped stream is a part of :type time_utils: TimeUtils :param time_utils: The time utility to use for interacting with time NTr ) �_fileobjr, �_transfer_coordinatorr- r �_bandwidth_limiting_enabledr �_request_token� _bytes_seen�_bytes_threshold)r r4 r. r5 r/ �bytes_thresholds r r � BandwidthLimitedStream.__init__d sK � �0 � � )��%9�"�%�� � � (�{�D� �+/��(� *�n��� ��� /� r c � � SU l g)z0Enable bandwidth limiting on reads to the streamTN�r@ r" s r �enable_bandwidth_limiting�0BandwidthLimitedStream.enable_bandwidth_limiting� s � �+/��(r c � � SU l g)z1Disable bandwidth limiting on reads to the streamFNrG r" s r r3 �1BandwidthLimitedStream.disable_bandwidth_limiting� s � �+0��(r c �D � U R ( d U R R U5 $ U =R U- sl U R U R : a U R R U5 $ U R 5 U R R U5 $ )zXRead a specified amount Reads will only be throttled if bandwidth limiting is enabled. )r@ r> �readrB rC � _consume_through_leaky_bucket)r �amounts r rM �BandwidthLimitedStream.read� s � � �/�/��=�=�%�%�f�-� -� ���F�"�� � � �d� 3� 3� 3��=�=�%�%�f�-� -� �*�*�,��}�}�!�!�&�)�)r c � � U R R ( d9 U R R U R U R 5 SU l g U R R e! [ a/ nU R R UR 5 S nAOS nAff = fU R R ( d M� Np)Nr ) r? � exceptionr, �consumerB rA r r- r% r )r �es r rN �4BandwidthLimitedStream._consume_through_leaky_bucket� s� � � �,�,�6�6� 5��"�"�*�*��$�$�d�&9�&9�� $%�� �� �,�,�6�6� 6�� ,� 5�� � �&�&�q�|�|�4�4�� 5�� �,�,�6�6�6s �7A+ �+ B$�5%B � B$c �$ � U R 5 g)z6Signal that data being read is being transferred to S3N)rH r" s r �signal_transferring�*BandwidthLimitedStream.signal_transferring� s � � �&�&�(r c �$ � U R 5 g)z:Signal that data being read is not being transferred to S3N)r3 r" s r �signal_not_transferring�.BandwidthLimitedStream.signal_not_transferring� s � � �'�'�)r c �: � U R R X5 g r: )r> �seek)r �where�whences r r] �BandwidthLimitedStream.seek� s � � � � ���5�)r c �6 � U R R 5 $ r: )r> �tellr" s r rb �BandwidthLimitedStream.tell� s � ��}�}�!�!�#�#r c � � U R ( a! U R ( a U R 5 U R R 5 g r: )r@ rB rN r> �closer" s r re � BandwidthLimitedStream.close� s1 � � � +� +��0@�0@� � .� .� 0� � � ��� r c � � U $ r: r r" s r � __enter__� BandwidthLimitedStream.__enter__� s � �� r c �$ � U R 5 g r: )re )r �args�kwargss r �__exit__� BandwidthLimitedStream.__exit__� s � � � � � r )r@ rB rC r> r, rA r- r? )Ni )r )r r r r r rH r3 rM rN rW rZ r] rb re rh rm r r r r r2 r2 c sG � � �"� !0�F0�1�*�(7�$)�*�*�$� ��r r2 c �B � \ rS rSr S S jrS rS rS rS rS r S r g) � LeakyBucket�� Nc �� � [ U5 U l X l Uc [ 5 U l [ R " 5 U l X0l Uc [ 5 U l X@l Uc [ 5 U l gg)a� A leaky bucket abstraction to limit bandwidth consumption :type rate: int :type rate: The maximum rate to allow. This rate is in terms of bytes per second. :type time_utils: TimeUtils :param time_utils: The time utility to use for interacting with time :type rate_tracker: BandwidthRateTracker :param rate_tracker: Tracks bandwidth consumption :type consumption_scheduler: ConsumptionScheduler :param consumption_scheduler: Schedules consumption retries when necessary N) �float� _max_rater- r � threading�Lock�_lock� _rate_tracker�BandwidthRateTracker�_consumption_scheduler�ConsumptionScheduler)r �max_rater/ � rate_tracker�consumption_schedulers r r �LeakyBucket.__init__� sf � �. �x� ���%�� � � (�{�D� � �^�^�%�� � )�� � �!5�!7�D� �&;�#� � (�*>�*@�D� '� )r c � � U R U R R 5 nU R R U5 ( a U R XU5 sSSS5 $ U R X5 ( a U R XU5 OU R X5 sSSS5 $ SSS5 g! , ( d f g= f)a Consume an a requested amount :type amt: int :param amt: The amount of bytes to request to consume :type request_token: RequestToken :param request_token: The token associated to the consumption request that is used to identify the request. So if a RequestExceededException is raised the token should be used in subsequent retry consume() request. :raises RequestExceededException: If the consumption amount would exceed the maximum allocated bandwidth :rtype: int :returns: The amount consumed N) rw r- r! rz � is_scheduled�,_release_requested_amt_for_scheduled_request� _projected_to_exceed_max_rate�!_raise_request_exceeded_exception�_release_requested_amt�r �amt� request_token�time_nows r rS �LeakyBucket.consume� s� � �$ �Z�Z��'�'�,�,�.�H��*�*�7�7� �F�F��H�H���� �Z� �3�3�C�B�B��6�6���� �2�2�3�A� �Z�� �Z�Z�s �A B0�#9B0�0 B>c �T � U R R X5 nX0R :� $ r: )rx �get_projected_ratert )r r� r� �projected_rates r r� �)LeakyBucket._projected_to_exceed_max_rate s% � � �+�+�>�>�s�M�� ���.�.r c �Z � U R R U5 U R X5 $ r: )rz � process_scheduled_consumptionr� r� s r r� �8LeakyBucket._release_requested_amt_for_scheduled_request s. � � �#�#�A�A� � � �*�*�3�9�9r c �| � U[ U R 5 - nU R R XU5 n[ XS9e)Nr )rs rt rz �schedule_consumptionr )r r� r� r� �allocated_timer s r r� �-LeakyBucket._raise_request_exceeded_exception# sB � � �u�T�^�^� 4�4���0�0�E�E� �� � � '� � � r c �< � U R R X5 U$ r: )rx �record_consumption_rate)r r� r� s r r� �"LeakyBucket._release_requested_amt, s � � ���2�2�3�A�� r )rz rw rt rx r- )NNN) r r r r r rS r� r� r� r� r r r r rp rp � s. � � �� "� !A�F B�>/�:� �r rp c �, � \ rS rSrS rS rS rS rSrg)r{ i1 c � � 0 U l SU l g)z*Schedules when to consume a desired amountr N�� _tokens_to_scheduled_consumption� _total_waitr" s r r � ConsumptionScheduler.__init__2 s � �02��-� ��r c � � XR ; $ )z�Indicates if a consumption request has been scheduled :type token: RequestToken :param token: The token associated to the consumption request that is used to identify the request. )r� )r �tokens r r� �!ConsumptionScheduler.is_scheduled7 s � � �=�=�=�=r c �| � U =R U- sl U R US.U R U' U R $ )aL Schedules a wait time to be able to consume an amount :type amt: int :param amt: The amount of bytes scheduled to be consumed :type token: RequestToken :param token: The token associated to the consumption request that is used to identify the request. :type time_to_consume: float :param time_to_consume: The desired time it should take for that specific request amount to be consumed in regardless of previously scheduled consumption requests :rtype: float :returns: The amount of time to wait for the specific request before actually consuming the specified amount. )� wait_duration�time_to_consume)r� r� )r r� r� r� s r r� �)ConsumptionScheduler.schedule_consumption@ sA � �& ���O�+�� !� -� -� .�8 ��-�-�e�4� � � � r c �| � U R R U5 n[ U R US - S5 U l g)z�Processes a scheduled consumption request that has completed :type token: RequestToken :param token: The token associated to the consumption request that is used to identify the request. r� r N)r� �pop�maxr� )r r� �scheduled_retrys r r� �2ConsumptionScheduler.process_scheduled_consumptionZ s= � � �?�?�C�C�E�J�� � � � ��/@� A� A�1� ��r r� N) r r r r r r� r� r� r r r r r{ r{ 1 s � � � >� �4 r r{ c �F � \ rS rSrS S jr\S 5 rS rS rS r S r Sr g ) ry ig c �, � Xl SU l SU l g)aZ Tracks the rate of bandwidth consumption :type a: float :param a: The constant to use in calculating the exponentional moving average of the bandwidth rate. Specifically it is used in the following calculation: current_rate = alpha * new_rate + (1 - alpha) * current_rate This value of this constant should be between 0 and 1. N)�_alpha� _last_time� _current_rate)r �alphas r r � BandwidthRateTracker.__init__h s � � � � ��� !��r c �6 � U R c gU R $ )zUThe current transfer rate :rtype: float :returns: The current tracked transfer rate � )r� r� r" s r � current_rate�!BandwidthRateTracker.current_ratex s � � �?�?� "���!�!�!r c �@ � U R c gU R X5 $ )a" Get the projected rate using a provided amount and time :type amt: int :param amt: The proposed amount to consume :type time_at_consumption: float :param time_at_consumption: The proposed time to consume at :rtype: float :returns: The consumption rate if that amt and time were consumed r� )r� �*_calculate_exponential_moving_average_rate�r r� �time_at_consumptions r r� �'BandwidthRateTracker.get_projected_rate� s' � � �?�?� "���>�>� � � r c �r � U R c X l SU l gU R X5 U l X l g)z�Record the consumption rate based off amount and time point :type amt: int :param amt: The amount that got consumed :type time_at_consumption: float :param time_at_consumption: The time at which the amount was consumed Nr� )r� r� r� r� s r r� �,BandwidthRateTracker.record_consumption_rate� s; � � �?�?� "� 1�O�!$�D� � � !� L� L� � ��� .�r c �H � X R - nUS:: a [ S5 $ X- $ )Nr �inf)r� rs )r r� r� � time_deltas r �_calculate_rate�$BandwidthRateTracker._calculate_rate� s* � �(�?�?�:� � ��?� ��<� ��!�!r c �| � U R X5 nU R U- SU R - U R - - $ )N� )r� r� r� )r r� r� �new_rates r r� �?BandwidthRateTracker._calculate_exponential_moving_average_rate� s; � � �'�'��A���{�{�X�%��T�[�[� �D�<N�<N�(N�N�Nr )r� r� r� N)g�������?) r r r r r �propertyr� r� r� r� r� r r r r ry ry g s0 � �"� �"� �"� �$.�$"�Or ry ) ru r! � Exceptionr r r r) r2 rp r{ ry r r r �<module>r� sk �� � � �y� �( � � !� !�$#� #�Ln� n�bZ� Z�z3 � 3 �lNO� NOr
| ver. 1.4 |
Github
|
.
| PHP 8.3.31 | Generation time: 0 |
proxy
|
phpinfo
|
Settings