�
ƪb� � � � d Z ddlmZ ddlZ eg d�ed�� � Zddd d
d d �Z ej d
ej � � Z
ej dej � � Z ej d� � Z ej dej
� � Z ej d� � Z ej dej z � � Z ej d� � Z edd� � Zd ej dej � � fd ej d� � fd ej d� � fd ej dej ej
z � � fd e fd e
fd ej d ej � � fd ej d!ej � � fd" ej d#d$� eej e� � � � z � � fd% ej d&ej � � fd' ej d(ej ej
z � � fg Zd)� Zd*� Zd+� Z d-d,�Z dS ).z�
babel.messages.jslexer
~~~~~~~~~~~~~~~~~~~~~~
A simple JavaScript 1.5 lexer which is used for the JavaScript
extractor.
:copyright: (c) 2013-2022 by the Babel Team.
:license: BSD, see LICENSE for more details.
� )�
namedtupleN)+�+�-�*�%z!=z==�<�>z<=z>=�=z+=z-=z*=z%=z<<z>>z>>>z<<=z>>=z>>>=�&z&=�|z|=z&&z||�^z^=�(�)�[�]�{�}�!�--�++�~�,�;�.�:T)�key�reverse�� �
�
� )�b�f�n�r�tz[\w$_][\w\d$_]*z[\w$_][\w\d$_.]*[\w\d$_.]z/=?z%/(?:[^/\\]*(?:\\.[^/\\]*)*)/[a-zA-Z]*z (\r\n|\n|\r)z\\z[a-fA-F0-9]{1,4}�Tokenztype value linenoz\s+z<!--.*� linecommentz//.*�multilinecommentz /\*.*?\*/� dotted_name�name�numberzb(
(?:0|[1-9]\d*)
(\.\d+)?
([eE][-+]?\d+)? |
(0x[a-fA-F0-9]+)
)�jsx_tagz(?:</?[^>\s]+|/>)�operatorz(%s)r �template_stringz `(?:[^`\\]*(?:\\.[^`\\]*)*)`�stringzT(
'(?:[^'\\]*(?:\\.[^'\\]*)*)' |
"(?:[^"\\]*(?:\\.[^"\\]*)*)"
)c � � g }t D ]9\ }}| s|rd|v r�|s|dk r�|dk r|s� d}|� ||f� � �:|S )ze
Get a tokenization rule list given the passed syntax options.
Internal to this module.
�jsxr0 r+ r, )�_rules�append)r3 �dottedr0 �rules�
token_type�rules �8/usr/lib/python3/dist-packages/babel/messages/jslexer.py� get_rulesr; 8 s� � �
�E� "� )� )��
�D�� �z� �e�z�&9�&9� � � �:�1B�#B�#B� � � � &� &��
�� �J�
� � �j�$�'�(�(�(�(� �L� c �< � | j dk r | j dv S | j dv S )zzA helper function that helps the tokenizer to decide if the current
token may be followed by a division operator.
r/ )r r r r r )r, r- r1 �regexp)�type�value)�tokens r: �indicates_divisionrB L s- � �
�z�Z� � ��{� 9�9�9� �:�?� ?�?r< c �r � | r | d | d k r
| d dv s
J d� � �t � d| dd� � � } g }|j }d} | � d|� � }|dk r�n || ||� � � | |dz }|t v r |t | � � n�|dv r�t
� | |d z � � }|��|� � � }t |� � d k r= |t t |d � � � � � � |d
z }��# t $ r Y nw xY w |||z � � |� � � }�� ||� � n ||� � |d z }��&|t | � � k r || |d
� � � d�
|� � S )z�Unquote a string with JavaScript rules. The string has to start with
string delimiters (``'``, ``"`` or the back-tick/grave accent (for template strings).)
r ���z"'`z)string provided is not properly delimitedz\1� �\�uU� N� � � � )� line_join_re�subr5 �find�escapes�
uni_escape_re�match�group�len�chr�int�
ValueError�end�join)r1 �result�add�pos�
escape_pos� next_char�escaped�
escaped_values r: �unquote_stringra U s � � � 4�f�Q�i�6�"�:�-�-�&��)�v�2E�2E�2E�3� 3F�2E�2E�
�
�
�e�V�A�b�D�\�
2�
2�F�
�F�
�-�C�
�C�% ��[�[��s�+�+�
� ��>�>� � ��F�3�z�>� "�#�#�#� �:��>�*� � �� � � �C�� �"� #� #� #� #� �$�
�
�#�)�)�&�*�q�.�A�A�G��"� '�
�
���
��}�%�%��*�*�!���C��M�2� 6� 6� 7� 7�8�8�8� )�1�n�� �� &� � � � �� ����
��I�
�-�.�.�.� �k�k�m�m�����I�����
�C� �N�N�N��1�n��K% �N �S��[�[��� ��F�3�4�4�L���� �8�8�F� � �s � &D, �,
D9�8D9c # �2 K � d}d}d}t | � � }t |||�� � }||k r�|D ] \ } }
|
� | |� � } | � nF� |r t � | |� � } d} n t � | |� � } d} | �|dz
}�m| � � � } | �$t
| | |� � }
t |
� � }|
V � |t t � | � � � � z
}| �
� � }||k ��dS dS )z�
Tokenize JavaScript/JSX source. Returns a generator of tokens.
:param jsx: Enable (limited) JSX parsing.
:param dotted: Read dotted names as single name token.
:param template_string: Support ES6 template strings
Fr rE )r3 r6 r0 Nr/ r> ) rT r; rR � division_re�regex_rerS r( rB �line_re�findallrX )�sourcer3 r6 r0 �
may_divider\ �linenorX r7 r8 r9 rR � token_valuerA s r: �tokenizerk � s= � � � � �J�
�C�
�F�
�f�+�+�C� �#�f�o� N� N� N�E�
��)�)� %� � � �J���J�J�v�s�+�+�E�� ��� !� �
&�#�)�)�&�#�6�6�� '�
�
� ���v�s�3�3�� %�
��}��q�����k�k�m�m� � � !��*�k�6�:�:�E�+�E�2�2�J��K�K�K��#�g�o�o�k�2�2�3�3�3���i�i�k�k��9 ��)�)�)�)�)�)r< )TTT) �__doc__� collectionsr �re�sortedrT � operatorsrP �compile�UNICODE�name_re�dotted_name_rerc �DOTALLrd re �patternrM rQ r( �VERBOSE�IrY �map�escaper4 r; rB ra rk � r< r: �<module>r| s� �� � � #� "� "� "� "� "� � � � � �F� � � �
�D�
�
�
� � �4�d��D�
A�
A��
�"�*�'���
4�
4����� 8�"�*�E�E���b�j�� � � � �2�:�>�� � J� J��
�"�*�_�
%�
%���r�z�%�'�/�1�2�2� ���
�.�/�/�
��
�7� /�0�0��
�:�2�:�f�b�j� )� )�*� �:�2�:�i� � �!��J�B�J�w�'�'�(�����L�"�*�r�y�2H�I�I�J��N�#� �W��
�z�r�z� �
�*� � � � �
��
�/���6�6�7�����G�c�h�h�s�s�2�9�i�/H�/H�&I�&I� I�J�J�K��
��
�#F��
�S�S�T�
�z�r�z� �
�*�r�y�
�"� "� #�!
��.� � �(@� @� @�5 � 5 � 5 �p*� *� *� *� *� *r< |