qi> d dl Z d dlZd dlZd dlmZmZ d dlmZ ddl m
Z
ddl m Z m
Z
ed Zdedz ded efd
Zd Zdd Zd
Z G d d Z G d de Z G d de
Zy) N)OptionalTypeVar )TrainerCallback)IntervalStrategy
has_length_Txmsgreturnc | t | | S N) RuntimeError)r
r s M/opt/pipecat/venv/lib/python3.12/site-packages/transformers/utils/notebook.py_requirer s y3 H c p t | } | dz | dz dz | dz }}}|dk7 r | d|dd|dS |dd|dS )z$Format `t` (in seconds) to (h):mm:ssi < r :02d)int)thmss r format_timer # s] AA4i!r'R R!qA%&!VaS!C!C !CAc7!Ac71CCr c & d| d| d| d| d| d S )Nz
)valuetotalprefixlabelwidths r html_progress_barr$ * s<
h wgeWOE7 C g r c d}|dz
}| d D ] }|d| dz
}
|dz
}| dd D ]; }|d z
}|D ]* }t |t r|d
n
t | }|d | d z
}, |d
z
}= |dz
}|S )z*Put the texts in `items` in an HTML table.z%
z*
r z
| z |
z
Nz
z.6fz
| z |
z
z
)
isinstancefloatstr)items html_codeilineelts r text_to_html_tabler/ 5 s | j# n-| j !| j | j |z
z | _ | j | || _ || _ | j | j dk( rd| _ yt% t' | j( | j z d | _ yy)a
The main method to update the progress bar to `value`.
Args:
value (`int`):
The value to use. Must be between 0 and `total`.
force_update (`bool`, *optional*, defaults to `False`):
Whether or not to force and update of the internal state and display (by default, the bar will wait for
`value` to reach the value it predicted corresponds to a time of more than the `update_every` attribute
since the last update to avoid adding boilerplate).
comment (`str`, *optional*):
A comment to add on the left of the progress bar.
Nr& r )r r: r9 time
start_time last_time start_value elapsed_timepredicted_remainingwarmup first_callswait_for
update_barminr average_time_per_itemr3 closemaxr r> )r? r rA r: current_times r updatezNotebookProgressBar.update s
"DL ?? "/3yy{ :DOdn16 6D t;? ?D 8 #{{D DM OOE "
doo
%l
T - - 1Uc$//TXTaTaBacgcmcm>n5n !# A% 99;L ,t >D t'''-1->->%$JZJZBZ-[*-1*
"
+/(zzJJL++7+/+E+EV[I[+\( OOE " #DO )DN**28R8RVW8W !
#C(9(9DDJ
%
%
- \N!DJJ4::,a D r r) boolr r@ rR rL rZ rO r r r r1 r1 F s " H FL
"6:
$$ d
$ $
23 $
$,1\C 1\t 1\cDj 1\f& :.r r1 c > e Zd ZdZd fd Zd Zd ZddZd Z xZ S ) r5 a
An object tracking the updates of an ongoing training with progress bars and a nice table reporting metrics.
Args:
num_steps (`int`): The number of steps during training. column_names (`list[str]`, *optional*):
The list of column names for the metrics table (will be inferred from the first call to
[`~utils.notebook.NotebookTrainingTracker.write_line`] if not set).
c J t | | |d n|g| _ d | _ y r )superr@ inner_table child_bar)r? num_steps column_names __class__s r r@ z NotebookTrainingTracker.__init__ s(
##/#74l^ r c ^ t | j | j | j | j | j
| _ | j (| xj t | j z
c_ | j )| xj | j j z
c_ | j :t j t j | j d | _
y | j j t j | j y r] )r$ r r r! r" r# r+ rl r/ rm r; r_ rZ r` rR ra s r rZ z NotebookTrainingTracker.display s *4::tzz4;;PTPZPZ\`\f\fg ' NN 01A1A B BN >> % NNdnn 6 6 6N ;; ,,tyy '@TRDK KK tyy 8 9r c | j 8t |j t |j g| _ y| j d }|D ] }||vs|j | || j d< t | j dkD r| j d }| j d d }|d || k7 r:| j j |D cg c] }|j
|d c} y|}|D ] }||vs||j | ||< |D cg c] }|| c}| j d< y| j j |D cg c] }|| c} yc c}w c c}w c c}w )z
Write the values in the inner table.
Args:
values (`dict[str, float]`): The values to display.
Nr r& zNo Log)rl listkeysvaluesappendrY getindex)r? rv columnskey last_values first_columnc
new_valuess r
write_linez"NotebookTrainingTracker.write_line sw # $V[[] 3T&--/5J KD &&q)G
(g%NN3'
( #*D Q 4##$q( " . .r 2 # / / 21 5 q>VL%99$$++g,VVZZ8-D,VW "(J $ J J.,7
a8H,IJqMJ DK+KaJqM+KD$$R( ''G(Dq(DE -W ,L(Ds E1' E6 E;c B t ||| | | _ | j S )a
Add a child progress bar displayed under the table of metrics. The child progress bar is returned (so it can be
easily updated).
Args:
total (`int`): The number of iterations for the child progress bar.
prefix (`str`, *optional*): A prefix to write on the left of the progress bar.
width (`int`, *optional*, defaults to 300): The width (in pixels) of the progress bar.
)r! r4 r# )r1 rm )r? r r! r# s r add_childz!NotebookTrainingTracker.add_child s! -U6$V[\~~ r c 2 d| _ | j y)z0
Closes the child progress bar.
N)rm rZ ra s r remove_childz$NotebookTrainingTracker.remove_child! s r r )Nrc )
rd re rf rg r@ rZ r r r
__classcell__)rp s @r r5 r5 s"
: F> r r5 c F e Zd ZdZd Zd Zd Zd dZd Zd dZ d d Z
d
Z y) NotebookProgressCallbackz
A [`TrainerCallback`] that displays the progress of training or evaluation, optimized for Jupyter Notebooks or
Google colab.
c . d | _ d | _ d| _ y )NF)training_trackerprediction_bar_force_next_updatera s r r@ z!NotebookProgressCallback.__init__/ s $ ""' r c |j t j k( rdnd| _ d| _ d| _ | j gdgz }|j t j k7 r|j d t |j | | _
y )NEpochStepr
Training LossValidation Loss)
eval_strategyr EPOCHr}
training_losslast_logNOrw r5 max_stepsr )r? argsstatecontrolkwargsro s r on_train_beginz'NotebookProgressCallback.on_train_begin4 s} '+'9'9=M=S=S'SGY_
))*o->> !1!4!4 4 1 2 7 V r c > t |j |j k( rt |j n
|j d}t | j d }|j |j
dz d| d|j | j d| _ y )NrW z0on_train_begin must be called before on_step_endr& Epoch rV r: rA F)r epochr r rR global_stepnum_train_epochsr )r? r r r r r tts r on_step_endz$NotebookProgressCallback.on_step_end= s $' $4 $CEKK EKKX[K\
d++-_
`
! UG1U%;%;$<= 00
#( r Nc n t | sy | j k| j *| j j t | | _ nt t | | _ | j j
d y | j j
| j j dz y )Nr& )r r r r rY r1 rR r )r? r r r eval_dataloaderr s r on_prediction_stepz+NotebookProgressCallback.on_prediction_stepG s /* &$$0&*&;&;&E&Ec/FZ&[#&9#o:N&O# & &q ) & &t':':'@'@1'D Er c ^ | j | j j d | _ y r )r rO )r? r r r r s r
on_predictz#NotebookProgressCallback.on_predictS s( * % % ' "r c |j t j k( rCd|v r>t | j d }d|d i}|j
|d< |j
| y y y )Nlossz+on_train_begin must be called before on_logr r )r r r r r r r )r? r r r logsr r rv s r on_logz NotebookProgressCallback.on_logX sb !1!4!4 44 $//1^_B%tF|4F " . .F6N MM& ! :H 4r c \ t | j d }ddd}t |j D ] }d|v s|d |d< n | j dk( rt |j |d< n|j |d< |i }d} |D ]+ }
|
j d st j d
d |
} - |j d d } |j d
d } |j | dd } |j | dd } |j | dd } |j D ]R \ }
} |
j d }
dj |
dd D cg c] }|j c} }|dk( rd}| ||< T |j! | |j# d | _ d| _ y c c}w )Nz0on_train_begin must be called before on_evaluatezNo log)r r r r r r eval_lossz\_loss$r7
total_flosr _runtime_samples_per_second_steps_per_second_rT r& Lossr T)r r reversed log_historyr} r r r endswithresubpopr* splitjoin
capitalizer r r r )r? r r r metricsr r rv logmetric_key_prefixkr vsplitspartnames r on_evaluatez$NotebookProgressCallback.on_evaluatea s
d++-_
`#+IE - -. C}*-f+'
' !%++ .F7O " . .F6N ?G " >Azz'"$&FF:r1$=! >
KK d + KK & KK,-X6 = KK,--@A4 H KK,-->? FMMO DAqWWS\F886!": F4T__ . FGDv~( F4L
f
""& Gs
F)
c t | j d }|j |j dt |j
d|j d d | _ y )Nz1on_train_begin must be called before on_train_endr rV Tr )r r rR r r r r )r? r r r r r s r on_train_endz%NotebookProgressCallback.on_train_end s]
d++-`
a
S - .a0F0F/GH
!% r r ) rd re rf rg r@ r r r r r r r r r r r r ) s2
(
W(
F#
"#'J%r r )rc )r< r rC typingr r IPython.displayrZ r_ trainer_callbackr
trainer_utilsr r r r) r r r$ r/ r1 r5 r r r r r s
$ . 8
T]
T
D"R. R.jK 1 K\d% d%r