{
"cells": [
{
"cell_type": "markdown",
"metadata": {
"id": "sb_auto_header",
"tags": [
"sb_auto_header"
]
},
"source": [
"\n",
"\n",
"\n",
"[
](https://colab.research.google.com/github/speechbrain/speechbrain/blob/develop/docs/tutorials/advanced/pre-trained-models-and-fine-tuning-with-huggingface.ipynb)\n",
"to execute or view/download this notebook on\n",
"[GitHub](https://github.com/speechbrain/speechbrain/tree/develop/docs/tutorials/advanced/pre-trained-models-and-fine-tuning-with-huggingface.ipynb)"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "79ryKiGHinQ3"
},
"source": [
"# Pretrained Models and Fine-Tuning with HuggingFace\n",
"\n",
"Training DNN models is often very time-consuming and expensive.\n",
"For this reason, whenever it is possible, using off-the-shelf pretrained models can be convenient in various scenarios.\n",
"\n",
"In SpeechBrain we provide pre-trained models and we also encourage users to share their own using
[HuggingFace Hub](https://huggingface.co/models)
as we strongly believe that sharing models can help research.\n",
"\n",
"You can browse our official pre-trained models [here](https://huggingface.co/speechbrain).\n",
"\n",
"If you have a pre-trained model and want to include it among the official ones, please consider opening a pull request on [GitHub](https://github.com/speechbrain/speechbrain/blob/develop/README.md) with all the details of your model!\n",
"\n",
"We provide a simple and straightforward way to download and instantiate a state-of-the-art pretrained-model and use it either for direct inference or for fine-tuning/knowledge distillation or whatever new fancy technique you can come up with!\n",
"\n",
"With this tutorial, you will learn how to:\n",
"\n",
"1. Use pretrained models to infer on your data.\n",
"2. Use pretrained models as a component of a new pipeline (e.g language models, finetuning, speaker embeddings extraction ...).\n",
"\n",
"## Prerequisites\n",
"- [SpeechBrain Introduction](https://speechbrain.readthedocs.io/en/latest/tutorials/basics/introduction-to-speechbrain.html)\n",
"- [YAML tutorial](https://speechbrain.readthedocs.io/en/latest/tutorials/basics/hyperpyyaml.html)\n",
"- [Brain Class tutorial](https://speechbrain.readthedocs.io/en/latest/tutorials/basics/brain-class.html)\n",
"- [DataIOBasics](https://speechbrain.readthedocs.io/en/latest/tutorials/basics/data-loading-pipeline.html)\n"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "HND7bB_1S07R"
},
"source": [
"## Installing Dependencies"
]
},
{
"cell_type": "code",
"execution_count": 1,
"metadata": {
"executionInfo": {
"elapsed": 34461,
"status": "ok",
"timestamp": 1706105674984,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "BAzQuVzl6ww1"
},
"outputs": [],
"source": [
"%%capture\n",
"# Installing SpeechBrain via pip\n",
"BRANCH = 'develop'\n",
"!python -m pip install git+https://github.com/speechbrain/speechbrain.git@$BRANCH"
]
},
{
"cell_type": "code",
"execution_count": 2,
"metadata": {
"executionInfo": {
"elapsed": 21062,
"status": "ok",
"timestamp": 1706105696010,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "_pC-98RDOqPq"
},
"outputs": [],
"source": [
"%%capture\n",
"import speechbrain\n",
"# here we download the material needed for this tutorial: images and an example based on mini-librispeech\n",
"!wget https://www.dropbox.com/s/b61lo6gkpuplanq/MiniLibriSpeechTutorial.tar.gz?dl=0\n",
"!tar -xvzf MiniLibriSpeechTutorial.tar.gz?dl=0\n",
"# downloading mini_librispeech dev data\n",
"!wget https://www.openslr.org/resources/31/dev-clean-2.tar.gz\n",
"!tar -xvzf dev-clean-2.tar.gz"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "_KCk7uODNgNB"
},
"source": [
"## Using PreTrained models to perform inference on your data\n",
"\n",
"In this section, we will provide examples on using pretrained models with various tasks including:\n",
"1. Automatic Speech Recognition.\n",
"2. Speaker Recognition, Verification and Diarization.\n",
"3. Source Separation\n",
"\n",
"**Many more can be found in our
[HuggingFace Hub](https://huggingface.co/models)
!**"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "m0xCb38O6kFM"
},
"source": [
"### Automatic Speech Recognition"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "PaWLPvJ2Nrxm"
},
"source": [
"Suppose we want to try out a pretrained ASR model on your data.\n",
"\n",
"Maybe we want to see if our new speech enhancement algorithm is able to also improve Word Error Rate or maybe we just want to transcribe a lecture recording.\n",
"\n",
"After browsing models on
[HuggingFace](https://huggingface.co/models)
, we choose the following ASR pipeline: [super cool and SOTA ASR pipeline](https://huggingface.co/speechbrain/asr-crdnn-rnnlm-librispeech), trained on LibriSpeech.\n",
"\n",
"This ASR pipeline is made of three components as detailed [here](https://huggingface.co/speechbrain/asr-crdnn-rnnlm-librispeech):\n",
"\n",
"\n",
"1. a CRDNN-based seq2seq E2E ASR model trained following this [recipe](https://github.com/speechbrain/speechbrain/tree/develop/recipes/LibriSpeech/ASR/seq2seq).\n",
"2. a RNN-based LM.\n",
"3. a SentencePiece Tokenizer object needed transforms words into subword units.\n",
"\n",
"**Now, we can transcribe any audio file in solely 3 lines of code!**\n"
]
},
{
"cell_type": "code",
"execution_count": 3,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/",
"height": 215,
"referenced_widgets": [
"73417ed270d7450984a48f3c7260eef7",
"85a4d1969185444aa63499a3e59faa2c",
"ee1bf41d42a54f9a92d76f5394626e97",
"5e58c000011c48879130e6374bbab799",
"7ea8ba3f9016452bb6ec20d3502675df",
"76a0e79fab2644908c86b7784d67504e",
"ab133c95b3da4bdf86777ade47d60698",
"7cfb724f62f14f889a3d3a69a9e7acd8",
"2e8935dded774cb9bcd87167992c5558",
"76fffbd6bc9542359181b3333077b888",
"1861687899e8426cb9bc7c74d0a51aea",
"4873f222358a46c7b50d741a1932c5a6",
"b5d8d5c9c94b4329a7cf143448476408",
"0adda9c3d3a14ceaa3d247b59c962554",
"a1e78669452a47899a85a7fae3a15661",
"8073c957b55e4b1c870b8e7c50d3765a",
"84bada4f0df245469620edab3ad40c38",
"3bd1dfae506d4299af956d497d96d9ad",
"402e80d5952d4da991f798672ff53d46",
"2232c1b90a0a40d7b470a492dd470197",
"3940e8873ae3498393094ea7c361a7fc",
"e2cf26fb7f29467daef310993935888f",
"d3278bfc8503432b8d16c9ad47963ee5",
"bac9acbddead48e1b90aded2f686c5d7",
"4b7f1dcce7c14f758c8b33e196214a88",
"4d695e2724324b5fa4af39345b38226c",
"baa6984bd26244ce849d203aa0d2dc30",
"b28ec6dd2556486693cb7657158b4f35",
"a6d2f27d5d4c493083ead216c8137c89",
"5c5bc290e7664009a63b8bc45d676aa7",
"adba26074a384a34ac2866813537c0d3",
"f81b74f0764a440392633978639dc9a8",
"0420cacd6a7349e8b7ccaef1ddc985b2",
"634871e7ef574c48a22fe20bd29c98fb",
"a2c4a9390bd6495aae3a79a7174f5832",
"de326e62dcee451ebafdef0a888f9974",
"fe6ee540077e4fd086ae8975feb97deb",
"890276931b55409cacaccbea256fe745",
"7b0782edb2394087910b772c90b03be9",
"0657d483243b46748b6dd499a188b588",
"d7765befe0af40e9bb810f5896f4b52a",
"8d0a5753b71243c59f4741043f98b857",
"304a1d7486b94d8c83371c54cfda2ca4",
"7a0a2f4b5b1c41c2bd27f1406568ff34",
"9e69e88263a24037aa45fb9f837c2c40",
"cb5045ef6ee544cf9e7f4d7cf772c14f",
"1ea356cbbabf483b94fac984fa0d3690",
"3301f47181664600aac6a0483dfa69a2",
"a3f6fdd0090c4c35b1f44d01be6d8e4f",
"3fec66291aed46e9aaec1e60748760d6",
"934446687ef449149f71c9c64923ed4d",
"303541f7df7044b1b43c6bd38d8058f1",
"1ff81f3732074056a9f1834501219e55",
"01a0f8b6ae4e4fbcaf1e96dd3adce92a",
"9707ff2d35094cfd97c39d166579cdba"
]
},
"executionInfo": {
"elapsed": 34118,
"status": "ok",
"timestamp": 1706105730109,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "GIJgefQpNnVO",
"outputId": "750201d3-46ab-493d-ad62-3ab2240d23ce"
},
"outputs": [
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "73417ed270d7450984a48f3c7260eef7",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"hyperparams_develop.yaml: 0%| | 0.00/4.83k [00:00, ?B/s]"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "4873f222358a46c7b50d741a1932c5a6",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"normalizer.ckpt: 0%| | 0.00/1.41k [00:00, ?B/s]"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "d3278bfc8503432b8d16c9ad47963ee5",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"asr.ckpt: 0%| | 0.00/480M [00:00, ?B/s]"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "634871e7ef574c48a22fe20bd29c98fb",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"lm.ckpt: 0%| | 0.00/212M [00:00, ?B/s]"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "9e69e88263a24037aa45fb9f837c2c40",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"tokenizer.ckpt: 0%| | 0.00/253k [00:00, ?B/s]"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"application/vnd.google.colaboratory.intrinsic+json": {
"type": "string"
},
"text/plain": [
"'THE LITTLE GIRL HAD BEEN ASLEEP BUT SHE HEARD THE RAPS AND OPENED THE DOOR'"
]
},
"execution_count": 3,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"from speechbrain.inference.ASR import EncoderDecoderASR\n",
"asr_model = EncoderDecoderASR.from_hparams(source=\"speechbrain/asr-crdnn-rnnlm-librispeech\", savedir=\"./pretrained_ASR\", hparams_file=\"hyperparams_develop.yaml\")\n",
"asr_model.transcribe_file(\"./LibriSpeech/dev-clean-2/1272/135031/1272-135031-0003.flac\")\n"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "JuULuuACaPfl"
},
"source": [
"We can validate this result by looking at the oracle transcription for this utterance."
]
},
{
"cell_type": "code",
"execution_count": 4,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"executionInfo": {
"elapsed": 102,
"status": "ok",
"timestamp": 1706105730111,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "JQ4IIIS8Z_ld",
"outputId": "a0906726-427b-489a-c44b-13733f3c1c84"
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"1272-135031-0000 BECAUSE YOU WERE SLEEPING INSTEAD OF CONQUERING THE LOVELY ROSE PRINCESS HAS BECOME A FIDDLE WITHOUT A BOW WHILE POOR SHAGGY SITS THERE A COOING DOVE\n",
"1272-135031-0001 HE HAS GONE AND GONE FOR GOOD ANSWERED POLYCHROME WHO HAD MANAGED TO SQUEEZE INTO THE ROOM BESIDE THE DRAGON AND HAD WITNESSED THE OCCURRENCES WITH MUCH INTEREST\n",
"1272-135031-0002 I HAVE REMAINED A PRISONER ONLY BECAUSE I WISHED TO BE ONE AND WITH THIS HE STEPPED FORWARD AND BURST THE STOUT CHAINS AS EASILY AS IF THEY HAD BEEN THREADS\n",
"1272-135031-0003 THE LITTLE GIRL HAD BEEN ASLEEP BUT SHE HEARD THE RAPS AND OPENED THE DOOR\n",
"1272-135031-0004 THE KING HAS FLED IN DISGRACE AND YOUR FRIENDS ARE ASKING FOR YOU\n",
"1272-135031-0005 I BEGGED RUGGEDO LONG AGO TO SEND HIM AWAY BUT HE WOULD NOT DO SO\n",
"1272-135031-0006 I ALSO OFFERED TO HELP YOUR BROTHER TO ESCAPE BUT HE WOULD NOT GO\n",
"1272-135031-0007 HE EATS AND SLEEPS VERY STEADILY REPLIED THE NEW KING\n",
"1272-135031-0008 I HOPE HE DOESN'T WORK TOO HARD SAID SHAGGY\n",
"1272-135031-0009 HE DOESN'T WORK AT ALL\n"
]
}
],
"source": [
"!head ./LibriSpeech/dev-clean-2/1272/135031/1272-135031.trans.txt"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "UHtw-fAJaX0A"
},
"source": [
"See, easy!"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "yWcM9NSNE_uX"
},
"source": [
"**NOTE**\n",
"\n",
"This syntax can be used also to load models which are in the local filesystem.\n",
"In fact, the model is not re-downloaded a second time if it is already found in the local `savedir`."
]
},
{
"cell_type": "code",
"execution_count": 5,
"metadata": {
"executionInfo": {
"elapsed": 7374,
"status": "ok",
"timestamp": 1706105737447,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "M8k-O63qE-j6"
},
"outputs": [],
"source": [
"from speechbrain.inference.ASR import EncoderDecoderASR\n",
"asr_model = EncoderDecoderASR.from_hparams(source=\"speechbrain/asr-crdnn-rnnlm-librispeech\", savedir=\"./pretrained_ASR\", hparams_file=\"hyperparams_develop.yaml\")"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "pVy5l-QT6qT3"
},
"source": [
"### Speaker Verification, Recognition and Diarization"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "KQS7Sv4rUAwh"
},
"source": [
"Now suppose we want to perform another task such as diarization and we need a speaker embedding extractor.\n",
"\n",
"Fortunately, we can use directly the pretrained ECAPA TDNN model available [here](https://huggingface.co/speechbrain/spkrec-ecapa-voxceleb). The model is trained with [Voxceleb 2](https://www.robots.ox.ac.uk/~vgg/data/voxceleb/) and we can use it to extract speaker embeddings for each utterance:\n"
]
},
{
"cell_type": "code",
"execution_count": 6,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/",
"height": 213,
"referenced_widgets": [
"518849236e44483f803078be7ad8dc93",
"f2660154764f4be4ba404d1e6e994271",
"0d3e8b469920445f88475b4496a5d66a",
"576907c14b614dbc8b7d0253909f9e99",
"ece9d78d617444f2a31fc912237d25cb",
"891f3d15f25a4cc2a64f4e7013d48e54",
"9713800931064fd3809f1fd0a2bc2d03",
"000de1ccc95c4cd8850d3a3424f4714a",
"5d221ae2b9ac4e36a7cfe2cce3c536dc",
"5ba74f54df8f4b11a58aee4c66b554f7",
"684b9471808648b7bda92f1dd4afb25f",
"b53ce8b214574bde84833798ab1e0a0e",
"975f5572379d4dd2b4776d5469ca1bb7",
"edb3172c98ff4ad8a27f35d1a7835906",
"a0317c2f06cf410783a893b8187e00c3",
"2fda19c612c5486dbf75a5de2d6ebcda",
"87d1d3bebd594b798db2cd726046fbb1",
"9c9985770a644c60a40d8a5479a19c48",
"241bb75e8c0141ec8c00ef562d0feb5f",
"98ea97d41a6c4565a238d184ac9bd09a",
"5bb62e9fe8f14b898666af7527389908",
"701f1496c0d145b8b376174ed9501cab",
"75d1e7af67264ffca59cc387db02d6d7",
"0d555777e2d2405698247f6fb163454d",
"a89727caed4642e7af12415c8ca66641",
"8718c8b37bea4e53ac6457276ce63045",
"dcfbc459a1d6415bb9cb71cf6d65a51f",
"eb2aa07593d44cbcae05ace5ace724a8",
"a2d5bacd3dfc4279b7434002341d000b",
"e94b2fcd8c8d495ea7ebd6beeab5dad0",
"c62d9509f5d9449590c067db7631d10a",
"611c74c530d44002b43a09e86fdd133a",
"c22924e5299d4ea79ad2dc6257ce8d6b",
"5338ff1061d14c89ad7c8bd7317a4642",
"a1b9d608708d4e9d962dbfa65f2b8951",
"6eaaa4ebfe4440ebb750c853a7545e17",
"84864afa1f0d447ca0d5a38f972ab1f3",
"6a38bd3599754589b4f9c17f39adeb92",
"ae6a556144e54692b1be363027c1e867",
"8e66c81421af4032a4048dda5f7db960",
"f0673eaf978145e780399c5d003abb33",
"a7436702e317468ba76a9c7ab1d7b7bd",
"38550314ccb744c78b779de82a9f6d8e",
"596d1f66a8cd480ab32af9f3f3025edc",
"0631b7878fd14f38b0f8270c1fafe391",
"f3bc35d9420f44239f719e2f4b37d379",
"df2df25b22aa434ebaa769dce4162ca8",
"7def4f14f4414bd3a0b25bb628863123",
"dcfa2ee4056a47a38a4bb14deafe7366",
"11890cbf63b24f13b0f3e75b7fc68d01",
"24ee8a32861b4a3daa79a35583175dc7",
"96b01ae3bf274b3e84cda3f94dd564fb",
"747b0366a0284c4188d441e934021fa8",
"886dbc6801664287b38590260ba33286",
"5217db8767a042f098a971ee4c02c731"
]
},
"executionInfo": {
"elapsed": 2279,
"status": "ok",
"timestamp": 1706105739651,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "sNO_28zyT5OS",
"outputId": "f200d136-f0f4-4b18-a1c1-48e6628c6667"
},
"outputs": [
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "518849236e44483f803078be7ad8dc93",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"hyperparams.yaml: 0%| | 0.00/1.92k [00:00, ?B/s]"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "b53ce8b214574bde84833798ab1e0a0e",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"embedding_model.ckpt: 0%| | 0.00/83.3M [00:00, ?B/s]"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "75d1e7af67264ffca59cc387db02d6d7",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"mean_var_norm_emb.ckpt: 0%| | 0.00/1.92k [00:00, ?B/s]"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "5338ff1061d14c89ad7c8bd7317a4642",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"classifier.ckpt: 0%| | 0.00/5.53M [00:00, ?B/s]"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "0631b7878fd14f38b0f8270c1fafe391",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"label_encoder.txt: 0%| | 0.00/129k [00:00, ?B/s]"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/plain": [
"torch.Size([1, 1, 192])"
]
},
"execution_count": 6,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"from speechbrain.inference.speaker import SpeakerRecognition\n",
"import torchaudio\n",
"verification = SpeakerRecognition.from_hparams(source=\"speechbrain/spkrec-ecapa-voxceleb\", savedir=\"./pretrained_ecapa\")\n",
"signal, fs = torchaudio.load('./LibriSpeech/dev-clean-2/1272/135031/1272-135031-0003.flac')\n",
"embedding = verification.encode_batch(signal)\n",
"embedding.shape"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "k7AKrsLECPE2"
},
"source": [
"We can visualize how this DNN is able to extract embeddings which are representative of the speaker identity with a **PCA**."
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "lnC6v3-9Cak8"
},
"source": [
"We select 20 random utterances from MiniLibriSpeech corpus:"
]
},
{
"cell_type": "code",
"execution_count": 7,
"metadata": {
"executionInfo": {
"elapsed": 45,
"status": "ok",
"timestamp": 1706105739653,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "54P7K8bOljwB"
},
"outputs": [],
"source": [
"import glob\n",
"import numpy as np\n",
"utterances = glob.glob(\"./LibriSpeech/dev-clean-2/**/*.flac\", recursive=True)"
]
},
{
"cell_type": "code",
"execution_count": 8,
"metadata": {
"executionInfo": {
"elapsed": 34,
"status": "ok",
"timestamp": 1706105739654,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "YLA8puMW_xOF"
},
"outputs": [],
"source": [
"np.random.shuffle(utterances)\n",
"utterances = utterances[:20]"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "yUsg7YgZCgVs"
},
"source": [
"We extract embeddings on the whole utterances and put corresponding oracle speaker IDs on a list."
]
},
{
"cell_type": "code",
"execution_count": 9,
"metadata": {
"executionInfo": {
"elapsed": 12391,
"status": "ok",
"timestamp": 1706105752014,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "WAK74neqmryW"
},
"outputs": [],
"source": [
"from pathlib import Path\n",
"\n",
"embeddings = []\n",
"labels = []\n",
"for u in utterances:\n",
" tmp, fs = torchaudio.load(u)\n",
" e = verification.encode_batch(tmp)\n",
" embeddings.append(e[0, 0].numpy())\n",
" spk_label = Path(u).parent.parent.stem\n",
" labels.append(spk_label)"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "ozhSGKS_CuRF"
},
"source": [
"We can use sklearn PCA for visualization."
]
},
{
"cell_type": "code",
"execution_count": 10,
"metadata": {
"executionInfo": {
"elapsed": 32,
"status": "ok",
"timestamp": 1706105752017,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "bfssZX_k_1VW"
},
"outputs": [],
"source": [
"from sklearn.decomposition import PCA\n",
"\n",
"embeddings = np.array(embeddings)\n",
"\n",
"pca = PCA(n_components=2)\n",
"principalComponents = pca.fit_transform(embeddings)"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "grjNqihhCykb"
},
"source": [
"Finally we can plot the results. It can be seen that some speakers are clustered well even when visualizing only two components with PCA:"
]
},
{
"cell_type": "code",
"execution_count": 11,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/",
"height": 486
},
"executionInfo": {
"elapsed": 637,
"status": "ok",
"timestamp": 1706105752629,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "j1U0N9b2ABG2",
"outputId": "0965e205-19ea-4cc0-dfd7-804590310cf3"
},
"outputs": [
{
"data": {
"text/plain": [
"Text(0, 0.5, 'Principal Component 2')"
]
},
"execution_count": 11,
"metadata": {},
"output_type": "execute_result"
},
{
"data": {
"image/png": "iVBORw0KGgoAAAANSUhEUgAAAlMAAAGwCAYAAACNeeBZAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjcuMSwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy/bCgiHAAAACXBIWXMAAA9hAAAPYQGoP6dpAAB5D0lEQVR4nO3dd1gUV9sG8HvpIE3qQgRFURAsERUFY0dADdFobFHsvZdYSKKgSSzB2KJBE2uiscYSjcGgWCM2EBU7iLFRVKQqdef7g495HQEFl879u6694s6cnX3OBNhnz5x5jkwQBAFERERE9F5UyjsAIiIiosqMyRQRERGREphMERERESmByRQRERGREphMERERESmByRQRERGREphMERERESlBrbwDqGwUCgWePHkCPT09yGSy8g6HiIiIikAQBKSkpMDS0hIqKiU7lsRkqpiePHkCKyur8g6DiIiI3sPDhw9Rq1atEj0mk6li0tPTA5D7P0NfX7+coyEiIqKiSE5OhpWVlfg5XpKYTBVT3qU9fX19JlNERESVTGlM0eEEdCIiIiIlMJkiIiIiUgKTKSIiIiIlMJkiIiIiUgKTKSIiIiIlMJkiKiN+fn6QyWSSh729vbg/NjYW3t7ekMvlqFGjBpycnPDHH39IjhEWFoYuXbrA0NAQxsbGGD16NFJTUyVt3nwPmUyGHTt2lEkfiYiqIyZTRGXI0dERMTEx4uPMmTPivsGDB+P27dv4888/ce3aNfTq1Qt9+/bF5cuXAeQWjHVzc4OtrS3Onz+PwMBAXL9+HUOHDs33Pps2bZK8T8+ePcuoh0RE1Q/rTBGVITU1Ncjl8gL3nT17FgEBAXB2dgYAfP3111i+fDlCQ0PRrFkzHDp0COrq6lizZo24FMLatWvRpEkTREZGwtbWVjyWoaFhoe9DREQliyNTRGXo7t27sLS0RN26dTFw4EA8ePBA3Ofq6oqdO3ciISEBCoUCO3bsQHp6Ojp06AAAyMjIgIaGhmRNKW1tbQCQjHABwIQJE2BiYgJnZ2ds3LgRgiCUfueIiKopJlNEpShHISAk6jkOhD+GvnVDbNy4CYGBgQgICEB0dDTatm2LlJQUAMCuXbuQlZUFY2NjaGpqYsyYMdi3b5844tSpUyfExsbC398fmZmZePHiBebMmQMAiImJEd9zwYIF2LVrF4KCgtC7d2+MHz8eP/74Y9l3noiomuBlPqJSEhgRg/kHbyAmKf3/t+jCwkALvo6m8PRoglatWqF27drYtWsXRowYgblz5yIxMRFHjx6FiYkJ9u/fj759++L06dNo3LgxHB0dsWXLFkyfPh0+Pj5QVVXF5MmTYW5uLhmtmjt3rvjvZs2aIS0tDf7+/pg8eXIZnwEioupBJnD8v1iSk5NhYGCApKQkrs1HhQqMiMG4rWF485crb0WogEFO8GxkgZYtW8LNzQ0jR46Era0tIiIi4OjoKLbPm3C+du1ayXHi4uJQo0YNyGQy6OvrY8eOHejTp0+Bsfz111/4+OOPkZ6eDk1NzRLsJRFR5VGan9+8zEdUwnIUAuYfvJEvkQIgbpt/8AaSklMQFRUFCwsLvHz5EgAkI0wAoKqqCoVCke845ubm0NXVxc6dO6GlpYUuXboUGk94eDhq1qzJRIqIqJTwMh9RCbsQnfDapb3/eRG8Adq2zlAzMEP0owR06fYNVFVVMWDAABgaGsLW1hZjxozB0qVLYWxsjP379yMoKAiHDh0Sj7F69Wq4urpCV1cXQUFBmDlzJhYvXgxDQ0MAwMGDBxEXF4fWrVtDS0sLQUFBWLhwIb744ouy6j4RUbXDZIqohMWn5E+kACA75RmeHfRHzqtkqGoboL5rG5w7dw6mpqYAgMOHD2POnDnw8vJCamoqbG1tsWXLFnTr1k08xoULF+Dr64vU1FTY29tj3bp18Pb2FvfnlU6YNm0aBEGAra0tli1bhlGjRpVup4mIqjEmU0Tvyc/PD/Pnz5dss7Ozw6a//gUA5KS+wIsTG/Hq/mUIma+gblQLNd3GoIZdGwDA96NaIynpP3Tp0gUXL16EqqoqevfujaioKOjq6orHlMlkeNP27dvRv3//fNs9PT3h6elZkt0kIqJ34JwpIiUUVNHc2cYIFgZaePbXMmQlPIJZr7mwGL4G2g1c8OzAEmTGRcHCQAu1NNNZ0ZyIqArgyBSREgqraO7r5YBuvjdh7D4empZ2AABD1/5IuXgAmbGR8J3RB38fPsiK5kREVQBHpoiUUFhFc89GFviwhTOyI/9FzqsUCIICaTdOAjlZ+H5Sf3g2smBFcyKiKoLJFFExFKeiefDhA2hpbYBHqwbg8bJeeHV8LQ79uR/Du7kCYEVzIqKqgpf5iIrofSqaJyVJK5oP6N+PFc2JiKoYVkAvJlZAr55Y0ZyIqHJjBXSicsSK5kRE9Da8zEf0DqxoTkREb8NkiugdWNGciIjeplLNmTp16hT8/f0RGhqKmJgY7Nu3T1K8cOjQodiyZYvkNR4eHggMDBSfJyQkYNKkSTh48CBUVFTQu3dvrFy5UlJx+m04Z6r6CYl6jgG/nHtnu+2jWsOlnnEZRERERMXFOVP/Ly0tDU2bNsWaNWsKbePp6SmpFL19+3bJ/oEDB+L69evi5ZZTp05h9OjRpR06VWJ5Fc3zL+qSSwbAwkALzjZGZRkWERFVEJXqMl/Xrl3RtWvXt7bR1NQstFL0zZs3ERgYiIsXL6JFixYAgB9//BHdunXD0qVLYWlpWeIxU+WnqiKDr5cDxm0NgwyQTETPS7B8vRygqlJYukVERFVZpRqZKooTJ07AzMwMdnZ2GDduHJ4/fy7uCwkJgaGhoZhIAbm3qquoqOD8+fMFHi8jIwPJycmSB1U/no0sEDDICXIDLcl2uYGWWBaBiIiqp0o1MvUunp6e6NWrF2xsbBAVFYUvv/wSXbt2RUhICFRVVREbGwszMzPJa9TU1GBkZITY2NgCj7lo0SLMnz+/LMKnCs6zkQW6OMhxIToB8SnpMNPLvbTHESkiouqtSiVT/fv3F//duHFjNGnSBPXq1cOJEyfQuXPn9zqmj48Ppk+fLj5PTk6GlZWV0rFS5aSqIuMkcyIikqhyl/leV7duXZiYmCAyMhIAIJfLER8fL2mTnZ2NhISEQudZaWpqQl9fX/IgIiIiylOlk6lHjx7h+fPnsLDInc/i4uKCxMREhIaGim2Cg4OhUCjQqlWr8gqTiIiIKrFKdZkvNTVVHGUCgOjoaISHh8PIyAhGRkaYP38+evfuDblcjqioKMyaNQu2trbw8PAAADRs2BCenp4YNWoU1q5di6ysLEycOBH9+/fnnXxERET0XipV0c4TJ06gY8eO+bYPGTIEAQEB6NmzJy5fvozExERYWlrC3d0d33zzDczNzcW2CQkJmDhxoqRo56pVq1i0k4iIqAorzc/vSpVMVQRMpoiIiCofVkAnIiIiqqCYTBEREREpgckUERERkRKYTBEREREpgckUERERkRKYTBEREREpgckUERERkRKYTBEREREpgckUERERkRKYTBEREREpgckUERERkRKYTBEREREpgckUERERkRKYTBEREREpgckUERERkRKYTBEREREpgckUERERkRKYTBEREREpgckUERERkRKYTBEREREpgckUERERkRKYTBEREREpgckUERERkRKYTBEREREpgckUERERkRKYTBEREREpgckUERERkRKYTBEREREpgckUERERkRKYTBEREREpgckUERERkRKYTBEREREpgckUERERkRKYTBEREREpgckUERERkRKYTBEREREpgckUERERkRKYTBEREREpgckUERERkRKYTBEREREpgckUERERkRKYTBEREREpgckUERERkRIqVTJ16tQpeHl5wdLSEjKZDPv375fsFwQB8+bNg4WFBbS1teHm5oa7d+9K2iQkJGDgwIHQ19eHoaEhRowYgdTU1DLsBREREVUllSqZSktLQ9OmTbFmzZoC93///fdYtWoV1q5di/Pnz6NGjRrw8PBAenq62GbgwIG4fv06goKCcOjQIZw6dQqjR48uqy4QERFRFSMTBEEo7yDeh0wmw759+9CzZ08AuaNSlpaWmDFjBr744gsAQFJSEszNzbF582b0798fN2/ehIODAy5evIgWLVoAAAIDA9GtWzc8evQIlpaW73zf5ORkGBgYICkpCfr6+qXWPyIiIio5pfn5XalGpt4mOjoasbGxcHNzE7cZGBigVatWCAkJAQCEhITA0NBQTKQAwM3NDSoqKjh//nyBx83IyEBycrLkQURERJSnyiRTsbGxAABzc3PJdnNzc3FfbGwszMzMJPvV1NRgZGQktnnTokWLYGBgID6srKxKIXoiIiKqrKpMMlVafHx8kJSUJD4ePnxY3iERERFRBVJlkim5XA4AiIuLk2yPi4sT98nlcsTHx0v2Z2dnIyEhQWzzJk1NTejr60seRERERHmqTDJlY2MDuVyOY8eOiduSk5Nx/vx5uLi4AABcXFyQmJiI0NBQsU1wcDAUCgVatWpV5jETERFR5adW3gEUR2pqKiIjI8Xn0dHRCA8Ph5GREaytrTF16lR8++23qF+/PmxsbDB37lxYWlqKd/w1bNgQnp6eGDVqFNauXYusrCxMnDgR/fv3L9KdfERERERvqlTJ1KVLl9CxY0fx+fTp0wEAQ4YMwebNmzFr1iykpaVh9OjRSExMxEcffYTAwEBoaWmJr9m2bRsmTpyIzp07Q0VFBb1798aqVavKvC9ERERUNVTaOlPlhXWmiIiIKh/WmSIiIiKqoJhMERERESmByRQRERGREphMERERESmByRQRERGREphMERERESmByRQRERGREphMERERESmByRQRERGREphMERERESmByRQRERGREphMERERESmByRQRERGREphMERERESmByRQRERGREphMERERESmh2MmUQqEodPuDBw+UDoiIiIioMilyMpWcnIy+ffuiRo0aMDc3x7x585CTkyPuf/r0KWxsbEolSCIiIqKKSq2oDefOnYsrV67gt99+Q2JiIr799luEhYVh79690NDQAAAIglBqgRIRERFVREUemdq/fz/WrVuHzz77DCNHjsSlS5fw9OlTeHl5ISMjAwAgk8lKLVAiospi0aJFaNmyJfT09GBmZoaePXvi9u3bkjaxsbHw9vaGXC5HjRo14OTkhD/++EPSJiEhAQMHDoS+vj4MDQ0xYsQIpKamivtv376Njh07wtzcHFpaWqhbty6+/vprZGVllUk/iShXkZOpp0+fonbt2uJzExMTHD16FCkpKejWrRtevnxZKgESEVU2J0+exIQJE3Du3DkEBQUhKysL7u7uSEtLE9sMHjwYt2/fxp9//olr166hV69e6Nu3Ly5fviy2GThwIK5fv46goCAcOnQIp06dwujRo8X96urqGDx4MP755x/cvn0bK1aswC+//AJfX98y7S9RdScTinhtzt7eHsuWLUO3bt0k21NTU+Hu7o6XL1/i2rVrknlUVVFycjIMDAyQlJQEfX398g6HiCqBp0+fwszMDCdPnkS7du0AALq6uggICIC3t7fYztjYGEuWLMHIkSNx8+ZNODg44OLFi2jRogUAIDAwEN26dcOjR49gaWlZ4HtNnz4dFy9exOnTp0u/Y0SVSGl+fhd5ZMrd3R2bNm3Kt11XVxdHjhyBlpZWiQZGRFRVJCUlAQCMjIzEba6urti5cycSEhKgUCiwY8cOpKeno0OHDgCAkJAQGBoaiokUALi5uUFFRQXnz58v8H0iIyMRGBiI9u3bl15niCifIk9Anz9/Pp48eVLgPj09PQQFBSEsLKzEAiMiqkxyFAIuRCcgPiUdZnpacLYxgqqKDAqFAlOnTkWbNm3QqFEjsf2uXbvQr18/GBsbQ01NDTo6Oti3bx9sbW0B5M6pMjMzk7yHmpoajIyMEBsbK9nu6uqKsLAwZGRkYPTo0ViwYEHpd5iIREVOpmrWrImaNWsWul9PT4/fhoioWgqMiMH8gzcQk5QubrMw0IKvlwMOrFmAiIgInDlzRvKauXPnIjExEUePHoWJiQn279+Pvn374vTp02jcuHGx3n/nzp1ISUnBlStXMHPmTCxduhSzZs0qkb4R0bsVOZkiIqL8AiNiMG5rGN6cfBqblI6+Q0ZB83EYLoT8i1q1aon7oqKisHr1akRERMDR0REA0LRpU5w+fRpr1qzB2rVrIZfLER8fLzlmdnY2EhISIJfLJdutrKwAAA4ODsjJycHo0aMxY8YMqKqqlnyHiSgfLidDRPSechQC5h+8kS+REgQBz4MC8PJOCD4YuAjWtetI9ufd/ayiIv0TrKqqKq4y4eLigsTERISGhor7g4ODoVAo0KpVq0JjUigUyMrKKnS1CiIqeRyZIiJ6TxeiEySX9vIkBAUg7cZJmPX6Gs8zVPH3hZtoUccIBgYG0NbWhr29PWxtbTFmzBgsXboUxsbG2L9/v1gCAQAaNmwIT09PjBo1CmvXrkVWVhYmTpyI/v37i3fybdu2Derq6mjcuDE0NTVx6dIl+Pj4oF+/flBXVy/Tc0FUnTGZIiJ6T/Ep+RMpAEi9fBgAELfdBwDgtSZ3+6ZNmzB06FCoq6vj8OHDmDNnDry8vJCamgpbW1ts2bJFUn5m27ZtmDhxIjp37gwVFRX07t0bq1atEverqalhyZIluHPnDgRBQO3atTFx4kRMmzatlHpMRAUpcp2pPKqqqoiJicl3l8nz589hZmbGOlNEVG2ERD3HgF/OvbPd9lGt4VLPuAwiIqLCVIg6U3kKy70yMjLENfqIqOIqylIn6enpmDBhAoyNjaGrq4vevXsjLi5O3P/8+XN4enrC0tISmpqasLKywsSJE5GcnCy2OXHiBGQyWb7Hm7f1V2bONkawMNBCYQtpyZB7V5+zjVEhLYioKijyZb68oWWZTIb169dDV1dX3JeTk4NTp07B3t6+5CMkohKVt9RJy5YtkZ2djS+//BLu7u64ceMGatSoAQCYNm0a/vrrL+zevRsGBgaYOHEievXqhX///RdA7sTpHj164Ntvv4WpqSkiIyMxYcIEJCQk4Pfff5e83+3btyXfAt8c1a7MVFVk8PVywLitYZABkonoeQmWr5cDVFW4bilRVVbky3w2NjYAgP/++w+1atWS3HKroaGBOnXqYMGCBW+9y6Qq4GU+qmreXOokKSkJpqam+P333/HZZ58BAG7duoWGDRsiJCQErVu3LvA4q1atgr+/Px4+fAggd2SqY8eOePHiBQwNDcuqO+XibXWmPBtZlGNkRJSnND+/izwyFR0dDQDo2LEj9u7d+9YCnkRUeby51EloaCiysrLg5uYmtrG3t4e1tXWhydSTJ0+wd+/eAgv3fvjhh8jIyECjRo3g5+eHNm3alFJPyo9nIwt0cZAXWAGdiKq+Yt/Nd/z48dKIg4hKUXGWOomNjYWGhka+0SRzc/N8850GDBiAAwcO4NWrV/Dy8sL69evFfRYWFli7di1atGiBjIwMrF+/Hh06dMD58+fh5ORU6n0ua6oqMk4yJ6qmip1M5eTkYPPmzTh27Bji4+PzFYYLDg4useCISHnvs9RJUS1fvhy+vr64c+cOfHx8MH36dPz0008AADs7O9jZ2YltXV1dERUVheXLl+O3335TrlNERBVIsZOpKVOmYPPmzejevTsaNWoEmYzD2EQV1fssdSKXy5GZmYnExETJ6FRcXFy+ZUzkcjnkcjns7e1hZGSEtm3bYu7cubCwKHiekLOz83snbkREFVWxk6kdO3Zg165dksJyRFTxvG2pk4Sja/HyTgjqjl6Wb6mT5s2bQ11dHceOHUPv3r0B5N6R9+DBA7i4uBT6fnmj1BkZGYW2CQ8PLzTRIiKqrIqdTGloaMDW1rY0YiGiEvS+S50YGBhgxIgRmD59OoyMjKCvr49JkybBxcVFnHx++PBhxMXFoWXLltDV1cX169cxc+ZMtGnTBnXq1AEArFixAjY2NnB0dER6ejrWr1+P4OBg/PPPP2V5GoiISl2xk6kZM2Zg5cqVWL16NS/xEVVg77vUCZA7Fypv+ZKMjAx4eHiIc6EAQFtbG7/88gumTZuGjIwMWFlZoVevXpgzZ47YJjMzEzNmzMDjx4+ho6ODJk2a4OjRo+jYsWMp9JaIqPwUezmZTz/9FMePH4eRkREcHR3zLaa5d+/eEg2womGdKaosuNQJEdH/VIg6U3kMDQ3x6aeflmgQRFTy8pY6iU1KzzdvCsit0C3nUidEREordjK1adOm0oiDiEoYlzohqt4CAgIQEBCA+/fvAwAcHR0xb948dO3aFffv3xdXNnnTrl270KdPHwAocDrP9u3b0b9/fwC5V6MCAgIQHh6OjIwMODo6ws/PDx4eHqXTqQqq2AsdA0B2djaOHj2KdevWISUlBUBuBeTU1NQSDa64/Pz88i2q+vp6ge9avJWoqvFsZIGAQU6QG2hJtssNtBAwyIlLnRBVYbVq1cLixYsRGhqKS5cuoVOnTujRoweuX78OKysrxMTESB7z58+Hrq4uunbtKjnOpk2bJO169uwp7jt16hS6dOmCw4cPIzQ0FB07doSXlxcuX75cxr0tX8WeM/Xff//B09MTDx48QEZGBu7cuYO6detiypQpyMjIwNq1a0sr1nfy8/PDnj17cPToUXGbmpoaTExMAADjxo3DX3/9hc2bN4uLt6qoqIiLtxYF50xRZVRYBXQiql6MjIzg7++PESNG5NvXrFkzODk5YcOGDeI2mUyGffv2SRKod3F0dES/fv0wb968kgi5xJTm53exR6amTJmCFi1a4MWLF9DW1ha3f/rppzh27FiJBvc+1NTUxEKCcrlcTKSSkpKwYcMGLFu2DJ06dULz5s2xadMmnD17FufOvXuSLlFllrfUSY8PP4BLPWMmUkTVTE5ODnbs2IG0tLQC68WFhoYiPDy8wCRrwoQJMDExgbOzMzZu3Ii3jcEoFAqkpKSIa31WF8WeM3X69GmcPXsWGhoaku116tTB48ePSyyw93X37l1YWlpCS0sLLi4uWLRoEaytrd9r8VYgtwDh60UIk5OTS70PRERExVXQCPSN6xFwcXFBeno6dHV1sW/fPjg4OOR77YYNG9CwYUO4urpKti9YsACdOnWCjo4O/vnnH4wfPx6pqamYPHlygTEsXboUqamp6Nu3b6n0saIqdjKlUCiQk5OTb/ujR4+gp6dXIkG9r1atWmHz5s2ws7MTr/+2bdsWERERxVq89XWLFi3C/PnzSzlyIiKi91fYGpxfetoiPDwcSUlJ2LNnD4YMGYKTJ09KEqpXr17h999/x9y5c/Md9/VtzZo1Q1paGvz9/QtMpn7//XfMnz8fBw4cgJmZWQn3sGIr9mU+d3d3rFixQnwuk8mQmpoKX1/fcl9ipmvXrujTpw+aNGkCDw8PHD58GImJidi1a9d7H9PHxwdJSUni4+HDhyUYMRERkXLy1uB8c8WD2KR0TN4Zgcj0GmjevDkWLVqEpk2bYuXKlZJ2e/bswcuXLzF48OB3vlerVq3w6NGjfMtG7dixAyNHjsSuXbskV4Cqi2InUz/88AP+/fdfODg4ID09HZ9//rl4iW/JkiWlEeN7MzQ0RIMGDRAZGSlZvPV1BS3e+jpNTU3o6+tLHkRERBVBYWtwAv8rhzL/4A3kKHKfKRSKfInQhg0b8Mknn8DU1PSd7xceHo6aNWtCU1NT3LZ9+3YMGzYM27dvR/fu3d+3K5VasS/z1apVC1euXMGOHTtw9epVpKamYsSIERg4cKBkQnpFkJqaiqioKHh7e7/34q1EREQVVWFrcALAi5OboV23BR4mmWJ74BlcP30YJ06cwJEjR8Q2kZGROHXqFA4fPpzv9QcPHkRcXBxat24NLS0tBAUFYeHChfjiiy/ENr///juGDBmClStXolWrVuK0mbx1PquLYpdGqMi++OILeHl5oXbt2njy5Al8fX0RHh6OGzduwNTUFOPGjcPhw4exefNmcfFWADh79myR34OlEYiIqKI4EP4YU3aEF7jv2eGVSP/vCnLSEmCgb4AWTh9i9uzZ6NKli9jmyy+/xNatW3H//n2oqEgvVgUGBsLHxweRkZEQBAG2trYYN24cRo0aJbbt0KEDTp48me+9hwwZgs2bN5dYP0tCaX5+v1cydffuXRw/fhzx8fFQKBSSfeVZV6J///44deoUnj9/DlNTU3z00Uf47rvvUK9ePQC5RTtnzJiB7du3SxZvfdtlvjcxmSIiooqCa3AWXYVKpn755ReMGzcOJiYmkMvlklLzMpkMYWFhJRpgRcNkioiIKoochYCPlgS/cw3OM7M7Vfv6chVqoeNvv/0W3333HWbPnl2igRAREVHxcA3OiqHYd/O9ePFCXACRiIiIyhfX4Cx/xR6Z6tOnD/755x+MHTu2NOIhIiKiYvJsZIEuDnKuwVlOip1M2draYu7cuTh37hwaN24MdXV1yf7CSswTERFR6clbg5PKXrEv8/3888/Q1dXFyZMnsXr1aixfvlx8vF4Znag8nDp1Cl5eXrC0tIRMJsP+/fsl++Pi4jB06FBYWlpCR0cHnp6euHv3rqRNbGwsvL29IZfLUaNGDTg5OeGPP/6QtLlz5w569OgBExMT6Ovr46OPPsLx48dLu3tERFQBFTuZio6OLvRx79690oiRqMjS0tLQtGlTrFmzJt8+QRDQs2dP3Lt3DwcOHMDly5dRu3ZtuLm5IS0tTWw3ePBg3L59G3/++SeuXbuGXr16oW/fvrh8+bLY5uOPP0Z2djaCg4MRGhqKpk2b4uOPP37rOo9ERFQ1KVW0M++lr5dHqOpYGqHykMlk2LdvH3r27AkgdzTJzs4OERERcHR0BJC7tIJcLsfChQsxcuRIAICuri4CAgLg7e0tHsvY2BhLlizByJEj8ezZM5iamuLUqVNo27YtACAlJQX6+voICgqqlutSERFVdKX5+V3skSkA+PXXX9G4cWNoa2tDW1sbTZo0wW+//VaigRGVtLz1qLS0/nfHi4qKCjQ1NXHmzBlxm6urK3bu3ImEhAQoFArs2LED6enp6NChA4DcxMrOzg6//vor0tLSkJ2djXXr1sHMzAzNmzcv0z4REVH5K/YE9GXLlmHu3LmYOHEi2rRpAwA4c+YMxo4di2fPnmHatGklHiRRYXIUQpHvXrG3t4e1tTV8fHywbt061KhRA8uXL8ejR48QExMjttu1axf69esHY2NjqKmpQUdHB/v27YOtrS2A3BGvo0ePomfPntDT04OKigrMzMwQGBiImjVrlkm/iYio4ih2MvXjjz8iICAAgwcPFrd98skncHR0hJ+fH5MpKjOBETGYf/CGZJFPCwMt+Ho5FFhXRV1dHXv37sWIESNgZGQEVVVVuLm5oWvXrnj9avfcuXORmJiIo0ePwsTEBPv370ffvn1x+vRpNG7cGIIgYMKECTAzM8Pp06ehra2N9evXw8vLCxcvXoSFBWu6EBFVJ8WeM6WlpYWIiAjxW3qeu3fvonHjxkhPL3j16qqCc6YqhsCIGIzbGpZv+YS8MamAQU7o2thSMmfqdUlJScjMzISpqSlatWqFFi1aYM2aNYiKioKtra1kXhUAuLm5wdbWFmvXrsWxY8fg7u6OFy9eSH4G6tevjxEjRmDOnDkl32EiIlJKhZozZWtri127duXbvnPnTtSvX79EgiJ6mxyFgPkHbxS4DlXetvkHb7z1GAYGBjA1NcXdu3dx6dIl9OjRAwDw8uVLAMi3erqqqqq4qHdhbVRUVPIt/E1ERFVfsS/zzZ8/H/369cOpU6fEOVP//vsvjh07VmCSRVTSLkQnSC7tvU6R+QrZL2LwX1zu8+joaISHh8PIyAjW1tbYvXs3TE1NYW1tjWvXrmHKlCno2bMn3N3dAeTOq7K1tcWYMWOwdOlSGBsbY//+/QgKCsKhQ4cAAC4uLqhZsyaGDBmCefPmQVtbG7/88guio6PRvXv3MjkHRERUcRQ7merduzfOnz+P5cuXiwURGzZsiAsXLqBZs2YlHR9RPvEphV9Kzoy9i7jtX4rPp0+fDgAYMmQINm/ejJiYGEyfPh1xcXGwsLDA4MGDMXfuXLG9uro6Dh8+jDlz5sDLywupqamwtbXFli1b0K1bNwCAiYkJAgMD8dVXX6FTp07IysqCo6MjDhw4gKZNm5ZSr4mIqKJ6r9IIzZs3x9atWxEaGorQ0FBs3bqViRSVGTM9rUL3aVk3gUGbAfm2nzt3DkDuckfdunWDlZUV4uPjsXbtWvTp0we3bt0S2xoZGSEtLQ2qqqrIzs5GQkICzp8/j+TkZLFNixYtMHjwYNSqVQvZ2dm4f/8+du/ejefPn5dgT4mIqDIo9sgUAOTk5GDfvn24efMmAMDBwQE9evSAmtp7HY6oWJxtjGBhoIXYpPQC500BgLZZHdy9fFYsk/D6z2bz5s0xcOBAWFtbIyEhAX5+fnB3d0d0dDRUVVWhoqKCHj164Ntvv4WpqSkiIyMxYcIEJCQk4PfffweQe2l78ODBWL58Oby8vPD48WOMHTsWo0aNwt69e0v7FBARUQVS7Lv5rl+/jk8++QSxsbGws7MDkFtZ2tTUFAcPHkSjRo1KJdCKgnfzVQx5d/MBkCRUMgAvzmyD8bMriLp1vUjHunr1Kpo2bYrIyEjUq1evwDarVq2Cv78/Hj58CABYunQpAgICEBUVJbb58ccfsWTJEjx69Oi9+kRERKWnQt3NN3LkSDg6OuLRo0cICwtDWFgYHj58iCZNmmD06NElGhxRYTwbWSBgkBPkBtJLfnIDLXzcxAKxD+/D0tISdevWxcCBA/HgwYMCj5OWloZNmzbBxsYGVlZWBbZ58uQJ9u7di/bt24vbXFxc8PDhQxw+fBiCICAuLg579uwR51UREVH1UeyRKW1tbVy6dElSgwcAIiIi0LJlS7x69apEA6xoODJVseRVQI9NeoWEtEwY6Woi+vIZfFBDhoYN7RETE4P58+fj8ePHiIiIgJ6eHgDgp59+wqxZs5CWlgY7Ozv89ddf+UalBgwYgAMHDuDVq1fw8vLCrl27JEvR7N69G8OHD0d6ejqys7Ph5eWFP/74A+rq6mV6DoiI6N0q1MhUgwYNEBcXl297fHx8vkKeRKVNVUWGpFeZ+P7IbXzz101M2xmOVXd0seKeMZ6omMLDwwOHDx9GYmKipHTHwIEDcfnyZZw8eRINGjRA37598xWcXb58OcLCwnDgwAFERUWJdwYCwI0bNzBlyhTMmzcPoaGhCAwMxP379zF27Ngy6zsREVUMxR6ZOnz4MGbNmgU/Pz+0bt0aQO6dUgsWLMDixYvx0UcfiW2r4sgNR6YqlqJUQvdsZIGWLVvCzc0NixYtyneMzMxM1KxZE+vXr8eAAfnvBARy159s27Ytnjx5AgsLC3h7eyM9PR27d+8utA0REVUcpfn5Xezb7z7++GMAQN++fSGT5X5k5eVjXl5e4nOZTIacnJySipMon3dVQpchtxK6i7UuoqKi4O3tXeBxBEGAIAjIyMgo9L3yKpvntXn58mW+u1dVVVXF4xERUfVR7GTq+PHjpREHUbEVVgn9RfAGaNs6Q83ADNGPEtCl2zdQVVXFgAEDcO/ePezcuRPu7u4wNTXFo0ePsHjxYmhra4uTxw8fPoy4uDi0bNkSurq6uH79OmbOnIk2bdqgTp06AHK/OIwaNQoBAQHw8PBATEwMpk6dCmdnZ1haWpblaSAionJW7GTq9TuaiMpTYZXQs1Oe4dlBf+S8SoaqtgHqu7bBuXPnYGpqiqysLJw+fRorVqzAixcvYG5ujnbt2uHs2bMwMzMDAHF5mGnTpiEjIwNWVlbo1auXZAHjoUOHIiUlBatXr8aMGTNgaGiITp06YcmSJWXSdyKiyiggIAABAQG4f/8+AMDR0RHz5s1D165dcf/+fdjY2BT4ul27dqFPnz4AIF4Ve9327dvRv39/AMDevXsREBCA8PBwZGRkwNHREX5+fnBxcSmdTuE95kwBQHp6Oq5evYr4+Ph8C7t+8sknJRZcRcQ5UxVHSNRzDPjl3DvbbR/VGi71jMsgIiIiepuDBw9CVVUV9evXhyAI2LJlC/z9/XH58mXY29vj6dOnkvY///wz/P39ERMTA11dXQC5ydSmTZvg6ekptjM0NBTvtp46dSosLS3RsWNHGBoaYtOmTVi6dCmOHTuGdu3alcrnd7GTqcDAQAwePBjPnj3Lf7BqME+KyVTFkaMQ8NGS4EIrocuQW3fqzOxOYiV0IiKqWIyMjODv748RI0bk29esWTM4OTlhw4YN4jaZTIZ9+/ahZ8+eRX4PR0dH9OzZEwsXLqwYpREmTZqEPn36ICYmBgqFQvKo6okUVSyqKjL4ejkA+N/de3nynvt6OTCRIiKqgHJycrBjxw6kpaUVeAkuNDQU4eHhBSZZEyZMgImJCZydnbFx48a33vijUCiQkpKCmjVrlmj8ryv2nKm4uDhMnz4d5ubmpREPUbHkVUKff/CGZDK63EALvl4O8GzEEgVEROUpr7hyfEo6zPS0oJ36GB+1cUV6ejp0dXWxb98+ODg45Hvdhg0b0LBhQ7i6ukq2L1iwAJ06dYKOjg7++ecfjB8/HqmpqZg8eXKB77906VKkpqbi008/xcyZM0ulj8W+zDd8+HC0adOmwEyxOuBlvorpzV9WZxsjjkgREZWzwIiYfF92zWuoYkxzfTQ118SePXuwfv16nDx5UpJQvXr1ChYWFpg7dy5mzJjx1veYN28eNm3aJK6d+rrff/8do0aNwoEDB+Ds7Fxqn9/FTqZevnyJPn36wNTUFI0bN863dEZhmWFVwWSKiIjo3YpaVNnNzQ316tXDunXrxDa//fYbRowYgcePH8PU1PSt7/PXX3/h448/Rnp6OjQ1NcXtO3bswPDhw7F792507969YhXt3L59O/755x9oaWnhxIkTklsUZTJZlU+miIiI6O2KWlS5i4McCoUiX9HkDRs24JNPPnlnIgUA4eHhqFmzpiSR2r59O4YPH44dO3age/fuynWmCIo9Af2rr77C/PnzkZSUhPv37yM6Olp83Lt3rzRiJKJCLFq0CC1btoSenh7MzMzQs2dP3L59u8C2giCga9eukMlk2L9/v7j9ypUrGDBgAKysrKCtrY2GDRti5cqV+V6/bds2NG3aFDo6OrCwsMDw4cPx/Pnz0uoaEVVihRZVPrkZ6Q8jkJUUh/8ib2HY+Gk4ceIEBg4cKLaJjIzEqVOnMHLkyHyvP3jwINavX4+IiAhERkYiICAACxcuxKRJk8Q2v//+OwYPHowffvgBrVq1QmxsLGJjY5GUlFQ6ncV7JFOZmZno168fVFSK/VKiSq9OnTqQyWT5HhMmTAAAxMbGwtvbG3K5HDVq1ICTkxP++OOPdx5j8eLFkjZXr15F27ZtoaWlBSsrK3z//fcFxnPy5ElMmDAB586dQ1BQELKysuDu7o60tLR8bVesWFFgsbvQ0FCYmZlh69atuH79Or766iv4+Phg9erVYpt///0XgwcPxogRI3D9+nXs3r0bFy5cwKhRo4p9Domo6iusqHJOWhKeHVqGx7+MQdyOr3DlciiOHDmCLl26iG02btyIWrVqISoqCk2aNIG+vj709fXh4uKC8PBwrFmzBq1bt0b9+vUxfvx4vHz5EgsWLBD/nn733XfIzs7GhAkTYGFhIT6sra0BAHv27BHfa+/evejSpQtMTU3F9zhy5Eix+1vsOVPTpk2Dqakpvvzyy2K/WVXAOVPV29OnTyUlQCIiItClSxccP34cHTp0gLu7OxITE7F69WqYmJjg999/h6+vLy5duoRmzZoByE2mRowYIUlE9PT0UKNGDQC5P2MNGjSAm5sbfHx8cO3aNQwfPhwrVqzA6NGj3xmfmZkZTp48iXbt2onbw8PD8fHHH+PSpUuwsLB4Z42WCRMm4ObNmwgODgaQezdMQEAAoqKixDY//vgjlixZgkePHhX9BBJRtVASRZVLusBnSkoKGjRogLi4OHHFi8IKfJ4/f178m10UxZ4zlZOTg++//x5HjhxBkyZN8k1AX7ZsWXEPSVRpvHn9fvHixahXr564zNLZs2cREBAAZ2dnAMDXX3+N5cuXIzQ0VPKLqaenB7lcXuB7bNu2DZmZmdi4cSM0NDTg6OiI8PBwLFu27J3JVN4wtpGRkbjt5cuX+Pzzz7FmzZpC37Og47x+DBcXF3z55Zc4fPgwunbtivj4eOzZs0dcz5CI6HXONkawMNB6Z1FlZxujAvbm8vLykjz/7rvvEBAQgHPnzsHR0THf37N9+/ahb9++YiKVx9DQEHK5HDo6OgAgVkoHckfsX7dw4UIcOHAABw8eLFYyVexrddeuXUOzZs2goqKCiIgIXL58WXyEh4cX93BElVZmZia2bt2K4cOHi5fPXF1dsXPnTiQkJEChUGDHjh1IT09Hhw4dJK9dvHgxjI2N0axZM/j7+yM7O1vcFxISgnbt2kFDQ0Pc5uHhgdu3b+PFixfIUQgIiXqOA+GPERL1HDmK3D9VCoUCU6dORZs2bdCoUSPxtdOmTYOrqyt69OhRpH6dPXsWO3fulCRubdq0wbZt29CvXz9oaGhALpfDwMAAa9asKfZ5I6Kqr6SLKpdEgc+OHTsCQJEKfL7+ZbIoij0ydfz48eK+hKhSK6yG1f79+5GYmIihQ4eKbXft2oV+/frB2NgYampq0NHRwb59+2Brayu2mTx5MpycnGBkZISzZ8/Cx8cHMTEx4qhubGxsvsU+84rk7j59DZuuZ0kmdlr8f4HSA2sWICIiAmfOnBH3/fnnnwgODsbly5eL1NeIiAj06NEDvr6+cHd3F7ffuHEDU6ZMwbx58+Dh4YGYmBjMnDkTY8eOlSzzQESU532KKpdmgc8///wTYWFhWLduHWbNmlVgzHkFPvv27Vu8zgpKePjwofDw4UNlDlHpJCUlCQCEpKSk8g6l2jh58qTw8ccfCxYWFgIAYd++fYW2HTNmjABAWL58eb59hw4dEpydnQUtLS3B0NBQ6NGjh7gvPDxc6N+/v1CrVi1BS0tLsLe3F1asWCH8fe2J0HrhUaH27EPio/XCo8Lf154I7u7uwscffyx5j4kTJwrOzs7C0aNHhfDwcMHPz08wMDAQrl69WmjMGzZsENTU1IT09HRBEAShS5cuwujRoyVtrl+/LgAQLEcESGKpPfuQUGf2IUHPqbtgYm4h3Lt3T/K6KVOmCDKZTFBVVRUfAAQVFRWhffv2+d7DzMxM+PLLL/PFOGjQIOGzzz6TbDt9+rQAQHjy5EmhfSMiys5RCGcjnwn7Lz8SzkY+E7JzFAW2K+jvrfOCv4UNf/0rXLp0SZgzZ45gYmIiXL9+XfK6ly9fCgYGBsLSpUvfGkfe5/cHH3xQ4P5t27YJOjo6QlBQULH7WOyRKYVCgW+//RY//PADUlNTAeTO/5gxYwa++uor3uVHJS4tLQ1NmzbF8OHD0atXr0Lb7du3D+fOnYOlpWW+fX/88QdGjRqFhQsXolOnTsjOzkZERIS4//U72qysrHD27FmMHDUKNT66Cb3m0uv2sUnpGLUmEE+OHsXevXvF7VFRUVi9ejUiIiLg6OgIAGjatClOnz6NNWvWYO3atQXG3apVK2RnZ+P+/fuws7ODXC5HXFycpM2TmFgAgIqudG0pQRCQcHQtXt4JQd3Ry2Bdu45k/5w5c/LdXty4cWMsX75cMh/h+vXr6NSpE4YMGYLvvvsuX4wvX76Empr0z4WqqqoYAxFRYVRVZIVOMs9TWIHP+LQcfHPqBQIGOWHRokW4ePEiVq5cKSnwuWfPHrx8+RKDBw8uUjyPHz9GRkZGvgKfI0eOxO7du+Hm5lbkvuV5rzpTq1evxuLFi8W5UgsXLsSPP/6IuXPnFjsAyi8gICDf7aB///23uL9Dhw75bq0fO3asuH/z5s0F3r4vk8kQHx8vtsvIyMBXX32F2rVrQ1NTE3Xq1MHGjRvLtK9F0bVrV3z77bf49NNPC23z+PFjTJo0Cdu2bct3U0R2djamTJkCf39/jB07Fg0aNICDg4NkGHf48OFYuXIl2rdvj7p162LA5wNh2NQdaXdC8r2XACDlWhBUaxjCs+v/JmC/fPkSAPJ9oVBVVYVCoSg09vDwcKioqIh3l7i4uODUqVPIysoS2/y25yDUjGpBVUs6sTIhKACp10/AxGsmnmeo4u8LNxEbG4tXr14BAORyORo1aiR5AIC1tbV4KTEiIgIdO3aEu7s7pk+fLtZkef1OGS8vL+zduxcBAQG4d+8e/v33X0yePBnOzs4FJq9EREX1rgKfQG6BzxyFoHSBTyB3QvqbBT6HDRuG7du3v3eBz2KPTG3ZsgXr16/HJ598Im5r0qQJPvjgA4wfP77Ab7VUPLVq1cLixYslt4P26NEDly9fFkc8Ro0ahQULFoivybtLAQD69esHT09PyTGHDh2K9PR08QMbAPr27Yu4uDhs2LABtra2iImJeeuHfkWlUCjg7e2NmTNniufndWFhYXj8+DFUVFTQrFkzxMbG4sMPP4S/v79kovbrLkQnIDUlOV/yAgCCoEDqtaOo4dAJYQ+TxW9c9vb2sLW1xZgxY7B06VIYGxtj//79CAoKwqFDhwDkTi4/f/48OnbsCD09PYSEhGDatGkYNGiQuKL5559/jvnz52PEiBGYPXs2IiIisHPzOui3zz+xMvXyYQBA3HYfAIDX/88H37Rpk2Qu19vs2bMHT58+xdatW7F161Zxe+3atXH//n0AuT8/KSkpWL16NWbMmAFDQ0N06tQJS5YsKdJ7EBEV5m0FPrXrtoCavin+e/oKw8YfxIkTJyR1oPIKfB4+fDjf6w8ePIi4uDi0bt0aWlpa+PPPPwEAY8aMEdv8/vvvGDJkCFauXCkW+AQAbW1tGBgYFLkPxU6mEhISYG9vn2+7vb09EhISins4KsC7bgcFcpOnwm5z19bWhra2tvj86dOnCA4OlkwUDgwMxMmTJ3Hv3j3xroU6deqUcE/eX3EWLl6yZAnU1NQKXcoorzK/n58fli1bhjp16uCHH35Ahw4dcOfOnQLv2jh1+gzSbp2G2We++fal3w9HTvJT6DbpIilMp66ujsOHD2POnDnw8vJCamoqbG1tsWXLFrGEgKamJnbs2AE/Pz9kZGTAxsYG06ZNw/Tp08XjGBgY4J9//sGECRPQvHlzmJiYYPikmTis4pwvltqzD0mev61mS543L8v5+fnBz8/vra8BgEmTJkmqDBMRlYR3FfjMSUuAimYNXGnUuNACn6/fMJNHXV0da9aswbRp0yAIAurWrQsgd/pDnp9//lks8JlXfBkAhgwZgs2bNxe5D8VOppo2bYrVq1dj1apVku2rV69G06ZNi3s4eoecnBzs3r073+2g27Ztw9atWyGXy+Hl5YW5c+dKRqde9+uvv0JHRwefffaZuO3PP/9EixYt8P333+O3335DjRo18Mknn+Cbb76RJGLloaBVxvPuWHtTaGgoVq5cibCwsAKrewMQR9u++uor9O7dG0DuyE2tWrWwe/duybcUIPey1+LpI2DQZgC0bZzyHU/bxklMYsz0tCT76tevn6/i+eucnJxw7ty7C9k1adIEp0+fFp/nKARcXhKsVM0WIqKK6M2/o3lMuk2RPF9bwJfFhQsXYuHChQW+3tPTU3KVJq/o9utTMU6cOPGeUUsVO5n6/vvv0b17dxw9elT8cA8JCcHDhw8LHGarqNasWQN/f3/ExsaiadOm+PHHH8VCi+WhOLeDfv7556hduzYsLS1x9epVzJ49G7dv35ZMhn7dhg0b8Pnnn0uSpHv37uHMmTPQ0tLCvn378OzZM4wfPx7Pnz/Hpk2byqTPBSlsEmJsUjrGbQ3L1/706dOIj48XlwkAchPQGTNmYMWKFbh//z4sLHJvv339dlpNTU3UrVsXDx48kBzvxo0b6Ny5M8aOHY0Tep0rTPKSV7Nl3NYwyABJTO9Ts4WIqKIoiQKf5a3YyVT79u1x584drFmzBrdu3QIA9OrVC+PHj680E1F37tyJ6dOnY+3atWjVqhVWrFghFkV8fU5RWSloJMa8hipW7foHTc01sWfPHgwZMgQnT56Eg4ODpJhi48aNYWFhgc6dOyMqKgr16tWTHDskJAQ3b97Eb7/9JtmuUCggk8mwbds28brwsmXL8Nlnn+Gnn34ql9GpoqwyDgAKxf9aeHt757vzwsPDA97e3hg2bBgAoHnz5tDU1MTt27fx0UcfAQCysrJw//591K5dW3zd63e0LVq4UEzsKkry8j41W4iIKrqq8GWx2GvzVQWtWrVCy5YtxYVcFQoFrKysMGnSJMm11IKU9Np8hY3E5P3IBAxygmcjC7i5uaFevXqS20HzpKWlQVdXF4GBgfDw8JDsGzFiBMLCwvIVbRwyZAj+/fdfREZGittu3rwJBwcH3LlzB/Xr11e6b8VV2FpOisxXyH4RAwCI2TwZk7/8BsP6fAwjIyPJiFSeOnXqYOrUqZg6daq4berUqdizZw82btyI2rVrw9/fHwcPHsStW7dQs2ZNREREoFOnTvDw8IC/v7/4uhN3nmHlv3EFXnIsr+SlOPPJiIgqi7dN8SiJv7elubZukUem7t69i3nz5mHdunX5gkhKSsK4cePw7bffihO8KqrMzEyEhobCx8dH3KaiogI3NzeEhOS/DT4jI0NyG2ZycnKJxVKUkZj5B2+gi4O8wNtB8+Qt45N3OStPamoqdu3ahUWLFuV7TZs2bbB7926kpqaK6xjduXMHKioqqFWrlhK9en+FTULMjL2LuO3/W1h71cK5WLVwbrEmCPr7+0NNTQ3e3t549eoVWrVqheDgYPEOurfd0RZ1L7pCJS9FqdlCRFTZeDayQBcHeYX6e1tURR6ZGj16NAwNDfH9998XuH/27NlITk5GQEBAiQZY0p48eYIPPvgAZ8+elUzonjVrFk6ePInz589L2vv5+WH+/Pn5jlMSmW1hIzGv3w6qyHwFN/W72PrzKhw5cgR169bF77//jm7dusHY2BhXr17FtGnTUKtWLZw8eVJynA0bNmDixImIiYmBoaGhZF9qaioaNmyI1q1bY/78+Xj27BlGjhyJ9u3b45dfflGqX++rJFYZJyIiKkhpjkwVuWjnyZMn0adPn0L39+3bF8HBwSUSVEXi4+ODpKQk8fHw4cMSO/a7bgd9/MsYxO34Clcuh4q3g2poaODo0aNwd3eHvb09ZsyYgd69e+PgwYP5jrNhwwb06tUrXyIFALq6uggKCkJiYiJatGiBgQMHwsvLK99dmmUpbxJiYd9BZMgd8q3IkxCJiKj6KfJlvgcPHrx1craJiUmJJhqlxcTEBKqqqvmW64iLiyuwbpOmpqakUmpJep/bQa2srPKNQBXm7Nmzb91vb2+PoKCgIh2rLFSFSYhERFT9FHlkysDAAFFRUYXuj4yMLPFhs9KgoaGB5s2b49ixY+I2hUKBY8eOSS77lQWOxOSXd8ea3ECaaMoNtMTJ+ERERBVJkUem2rVrhx9//BGdOnUqcP+qVavQtm3bEgusNE2fPh1DhgxBixYt4OzsjBUrViAtLU28lb6scCSmYJV5EiIREVU/RR6Z8vHxwd9//43PPvsMFy5cEOcQnT9/Hr1798aRI0ckd8hVZP369cPSpUsxb948fPjhhwgPD0dgYCDMzc3LPJaqPhLzvos2592x9iI8CK62JlBTVakSizYTEVHVU6w6U4cOHcLw4cPx/PlzyXZjY+N8ix9XVaV1N0BVrR108OBBqKqqShZt9vf3Fxdt7tChAxo0aJBv0ea8c/vq1SskJSVJjpm3aPPrywD06NEDcXFx+PbbbyWLNrdp06ZM+klERBVbhagzBQAff/wx/vvvPwQGBiIyMhKCIKBBgwZwd3cvdF04KpqqWjuIizYTEVFVV+zlZLS1tfHpp5+WRixUxVXHRZuJiKjqK3YyRfQuXLSZiIiqk2q5Np8ySvOaa1VQ2KLNY5rri4s2r1+/Xly0+U3BwcHo3LkzIiMjC1y02dXVFZcuXULz5s3F7e7u7jh9+jRiY2PFRZv37t2Lzz77DGlpaRydIiKiilEBnehd8hZtfj2RAoD4tBx8c+oFnmpaYtGiRWjatClWrlxZ4DFatWoFAJIFmPOsX78eH374oSSRAnLXJPzggw/ERAoAGjZsCEEQ8OjRI2W7RURE9FZMpqhEvGvRZiB30eYchaDUos0jRozI95o2bdrgyZMnSE1NFbeV96LNRERUfRRpzlRycnKRD8hLX9XTheiEfCNSgHTR5v+evsKw8Qdx4sQJHDlyBFFRUQUu2tyuXTs0adJEcpydO3ciOzsbgwYNyvcen3/+Ob755hsMGzZMXLR55syZGD58OC/xERFRqStSMmVoaAiZ7O01jwRBgEwmQ05OTokERpXLuxZtzklLgIpmDVxp1FhctPnhw4c4evSoWIHeysoKvXv3xtdff53vOEVZtHnSpElo0aIFjI2N0bdvX3z77bcl3U0iIqJ8ijQBvagL6wJA+/btlQqoouME9IKFRD3HgF/OvbPd9tcWbSYiIior5V60s6onSKS8vEWbY5PSC5w3JUPuEjnVadFmIiKqHt67ztTLly/x4MEDZGZmSra/OdeFqgcu2kxERNVVsZOpp0+fYtiwYZLFal/HOVPVV96izW/WmZIbaMHXy6HSL9pMRERUkGInU1OnTkViYiLOnz+PDh06YN++feICsz/88ENpxEiViGcjC3RxkFfJRZuJiIgKUuxkKjg4GAcOHECLFi2goqKC2rVro0uXLtDX18eiRYvQvXv30oiTKpGqumgzERFRQYpdtDMtLQ1mZmYAgJo1a+Lp06cAgMaNGyMsLKxkoyMiIiKq4IqdTNnZ2eH27dsAgKZNm2LdunV4/Pgx1q5dm69qNRFVbjk5OZg7dy5sbGygra2NevXq4ZtvvkFeRZWsrCzMnj0bjRs3Ro0aNWBpaYnBgwfjyZMnkuOEhYWhS5cuMDQ0hLGxMUaPHi2pWL9582bIZLICH/Hx8WXaZyKi4ip2MjVlyhTExMQAAHx9ffH333/D2toaq1atwsKFC0s8QCIqP0uWLEFAQABWr16NmzdvYsmSJfj+++/x448/Asi9qzcsLAxz585FWFgY9u7di9u3b+OTTz4Rj/HkyRO4ubnB1tYW58+fR2BgIK5fv46hQ4eKbfr164eYmBjJw8PDA+3btxdHwomIKqoiFe18m5cvX+LWrVuwtraGiYlJScVVYbFoJ1UnH3/8MczNzbFhwwZxW+/evaGtrY2tW7cW+JqLFy/C2dkZ//33H6ytrfHzzz9j7ty5iImJgYpK7ve3a9euoUmTJrh79y5sbW3zHePp06f44IMPsGHDBnh7e5dO54ioWinNz2+lFjoWBAHa2tpwcnKqFokUUXXj6uqKY8eO4c6dOwCAK1eu4MyZM+jatWuhr0lKSoJMJhOX/snIyICGhoaYSAEQ10w8c+ZMgcf49ddfoaOjg88++6yEekJEVHreK5nasGEDGjVqBC0tLWhpaaFRo0ZYv359ScdGROVszpw56N+/P+zt7aGuro5mzZph6tSpGDhwYIHt09PTMXv2bAwYMED85tepUyfExsbC398fmZmZePHiBebMmQMA4pSBN23YsAGff/45F6omokqh2KUR5s2bh2XLlmHSpElwcXEBAISEhGDatGl48OABFixYUOJBElHZyVEIYp2wKycPY9u2bfj999/h6OiI8PBwTJ06FZaWlhgyZIjkdVlZWejbty8EQUBAQIC43dHREVu2bMH06dPh4+MDVVVVTJ48Gebm5pLRqjwhISG4efMmfvvtt1LvKxFRSSj2nClTU1OsWrUKAwYMkGzfvn07Jk2ahGfPnpVogBUN50xRVRYYESOpYP/op6Gw6jAAAQt9xAr23377LbZu3Ypbt26Jr8tLpO7du4fg4GAYGxdcZywuLg41atSATCaDvr4+duzYgT59+kjajBgxAmFhYbh8+XIp9ZKIqqMKNWcqKysLLVq0yLe9efPmyM7OLpGgiKjsBUbEYNzWMMlSQEJWBpIzcjBuaxgCI3IvyamqqkKhUIht8hKpu3fv4ujRo4UmUgBgbm4OXV1d7Ny5E1paWujSpYtkf2pqKnbt2oURI0aUcO+IiEpPsS/zeXt7IyAgAMuWLZNs//nnnwudR0FEFVuOQsD8gzfw5jC1tq0zks7uhJq+KXx+TURaK20sW7YMw4cPB5CbSH322WcICwvDoUOHkJOTg9jYWACAkZERNDQ0AACrV6+Gq6srdHV1ERQUhJkzZ2Lx4sXiJPU8O3fuRHZ2NgYNGlTaXSYiKjHFvsw3adIk/Prrr7CyskLr1q0BAOfPn8eDBw8wePBgqKuri23fTLiqAl7mo6ooJOo5BvxyLt92RcZLJJ7eipd3Q6B4mQQLC0sMGzwQ8+bNg4aGBu7fvw8bG5sCj3n8+HF06NABADB48GD89ddfSE1Nhb29Pb744osCSx64urrCxsYG27ZtK9H+ERGV5ud3sZOpjh07Fu3AMhmCg4PfK6iKjMkUVUUHwh9jyo7wd7Zb2f9D9Pjwg9IPiIiohJXm53exL/MdP368RAMgovJnpqdVou2IiKoTpYp2ElHV4GxjBAsDLcgK2S8DYGGgBWcbo7IMi4ioUijSyFSvXr2wefNm6Ovro1evXm9tu3fv3hIJjIjKjqqKDL5eDhi3NQwyQDIRPS/B8vVygKpKYekWEVH1VaRkysDAADKZTPw3EVU9no0sEDDISVJnCgDkBlrw9XIQ60wREZGU0gsdVzecgE5V3esV0M30ci/tcUSKiCq7CjUBPTo6GtnZ2ahfv75k+927d6Guro46deqUVGxEVA5UVWRwqVd44U0iIpIq9gT0oUOH4uzZs/m2nz9/HkOHDi2JmIiIiIgqjWInU5cvX0abNm3ybW/dujXCw8NLIiYiIiKiSqPYyZRMJkNKSkq+7UlJScjJySmRoIiIiIgqi2InU+3atcOiRYskiVNOTg4WLVqEjz76qESDIyIiIqroij0BfcmSJWjXrh3s7OzQtm1bAMDp06eRnJxcJZePISIiInqbYo9MOTg44OrVq+jbty/i4+ORkpKCwYMH49atW2jUqFFpxEhERERUYbHOVDGxzhQREVHlU6HqTAFAYmIiLly4gPj4eCgUCsm+wYMHl0hgRERERJVBsZOpgwcPYuDAgUhNTYW+vr64zAyQe6cfkykiIiKqToo9Z2rGjBkYPnw4UlNTkZiYiBcvXoiPhISE0oiRiIiIqMIqdjL1+PFjTJ48GTo6OqURDxFRuVu0aBFatmwJPT09mJmZoWfPnrh9+7akTYcOHSCTySSPsWPHStpMnjwZzZs3h6amJj788MMy7AERlaViJ1MeHh64dOlSacSitDp16uT747Z48WJJm6tXr6Jt27bQ0tKClZUVvv/++3KKlogqqpMnT2LChAk4d+4cgoKCkJWVBXd3d6SlpUnajRo1CjExMeKjoL8nw4cPR79+/coqdCIqB8WeM9W9e3fMnDkTN27cQOPGjaGuri7Z/8knn5RYcO9jwYIFGDVqlPhcT09P/HdycjLc3d3h5uaGtWvX4tq1axg+fDgMDQ0xevTo8giXiCqgwMBAyfPNmzfDzMwMoaGhaNeunbhdR0cHcrm80OOsWrUKAPD06VNcvXq1dIIlonJX7GQqL1FZsGBBvn0ymazcl5TR09Mr9I/btm3bkJmZiY0bN0JDQwOOjo4IDw/HsmXLmEwRUaGSkpIAAEZGRpLt27Ztw9atWyGXy+Hl5YW5c+dyCgRRNVTsy3wKhaLQR3knUgCwePFiGBsbo1mzZvD390d2dra4LyQkBO3atYOGhoa4zcPDA7dv38aLFy8KPF5GRgaSk5MlDyKqenIUAkKinuNA+GOERD1HjiK3BJ9CocDUqVPRpk0bSWHizz//HFu3bsXx48fh4+OD3377DYMGDSqv8ImoHL1XnamKavLkyXBycoKRkRHOnj0LHx8fxMTEYNmyZQCA2NhY2NjYSF5jbm4u7qtZs2a+Yy5atAjz588v/eCJqNwERsRg/sEbiElKF7dZGGjB18sBB9YsQEREBM6cOSN5zeuj2Y0bN4aFhQU6d+6MqKgo1KtXr8xiJ6LyV6RkatWqVRg9ejS0tLTEOQCFmTx5cokElmfOnDlYsmTJW9vcvHkT9vb2mD59uritSZMm0NDQwJgxY7Bo0SJoamq+1/v7+PhIjpucnAwrK6v3OhYRVTyBETEYtzUMby4FEZuUjr5DRkHzcRguhPyLWrVqvfU4rVq1AgBERkYymSKqZoqUTC1fvhwDBw6ElpYWli9fXmg7mUxW4snUjBkzMHTo0Le2qVu3boHbW7VqhezsbNy/fx92dnaQy+WIi4uTtMl7Xtg8K01NzfdOxIioYstRCJh/8Ea+REoQBCQcXYuXd0JQd/QyWNeu885jhYeHAwAsLCxKPE4iqtiKlExFR0cX+O+yYGpqClNT0/d6bXh4OFRUVGBmZgYAcHFxwVdffYWsrCzxLsSgoCDY2dkVeImPiKq2C9EJkkt7eRKCApB24yTMen2N5xmq+PvCTbSoYwQDAwNoa2sjKioKv//+O7p16wZjY2NcvXoV06ZNQ7t27dCkSRPxOJGRkUhNTUVsbCxevXolJlwODg6SuZtEVLkVa6HjrKws2Nvb49ChQ2jYsGFpxlVsISEhOH/+PDp27Ag9PT2EhIRg2rRp6Nq1K7Zs2QIg944cOzs7uLu7Y/bs2YiIiMDw4cOxfPnyIt/Nx4WOiaqOA+GPMWVHeL7t/y35uMD2mzZtwtChQ/Hw4UMMGjQIERERSEtLg5WVFT799FN8/fXXkr8LHTp0wMmTJ/MdJzo6GnXq1CmpbhBREVSYhY7V1dWRnp7/W1xFoKmpiR07dsDPzw8ZGRmwsbHBtGnTJPOdDAwM8M8//2DChAlo3rw5TExMMG/ePJZFIKqmzPS0Ctxee/YhyfPto1rDpZ6x+NzKyqrAJOlNJ06cUCo+IqocijUyBQALFy7EnTt3sH79eqipVambAYuEI1NEVUeOQsBHS4IRm5Seb94UAMgAyA20cGZ2J6iqyApoQUSVRYUZmQKAixcv4tixY/jnn3/QuHFj1KhRQ7J/7969JRYcEVFpUlWRwdfLAeO2hkEGSBKqvNTJ18uBiRQRvVWxkylDQ0P07t27NGIhIipzno0sEDDIKV+dKfn/15nybMS784jo7Yp9ma+642U+oqopRyHgQnQC4lPSYaanBWcbI45IEVUhFeIyn0KhgL+/P/78809kZmaic+fO8PX1hba2dokGRERUHlRVZJJJ5kRERVXktfm+++47fPnll9DV1cUHH3yAlStXYsKECaUZGxEREVGFV+Rk6tdff8VPP/2EI0eOYP/+/Th48CC2bdsGhUJRmvERERERVWhFTqYePHiAbt26ic/d3Nwgk8nw5MmTUgmMiIiIqDIocjKVnZ0NLS1pgTt1dXVkZWWVeFBERERElUWRJ6ALgoChQ4dKFv1NT0/H2LFjJbWmWGeKiIiIqpMiJ1NDhgzJt23QoEElGgwRERFRZVPkZGrTpk2lGQcRERFRpVTkOVNERERElB+TKSIiIiIlMJkiIiIiUgKTKSIiIiIlMJkiIiIiUgKTKSIiIiIlMJkiIiIiUgKTKSIiIiIlMJkiIiIiUgKTKSIiIiIlMJkiIiIiUgKTKSIiIiIlMJkiIiIiUgKTKSIiIiIlMJkiIiIiUgKTKSIiIiIlMJkiIiIiUgKTKSIiIiIlMJkiIiIiUgKTKSIiqnT8/Pwgk8kkD3t7e0mbkJAQdOrUCTVq1IC+vj7atWuHV69eifvDwsLQpUsXGBoawtjYGKNHj0ZqamqB7/f8+XPUqlULMpkMiYmJpdk1qoSYTBERUaXk6OiImJgY8XHmzBlxX0hICDw9PeHu7o4LFy7g4sWLmDhxIlRUcj/2njx5Ajc3N9ja2uL8+fMIDAzE9evXMXTo0ALfa8SIEWjSpElZdIsqIbXyDoCIiOh9qKmpQS6XF7hv2rRpmDx5MubMmSNus7OzE/996NAhqKurY82aNWKCtXbtWjRp0gSRkZGwtbUV2wYEBCAxMRHz5s3D33//XUq9ocqMI1NERFQp3b17F5aWlqhbty4GDhyIBw8eAADi4+Nx/vx5mJmZwdXVFebm5mjfvr1k5CojIwMaGhpiIgUA2traACBpd+PGDSxYsAC//vqrpC3R6/iTQURElUKOQkBI1HMcCH8MfeuG2LhxEwIDAxEQEIDo6Gi0bdsWKSkpuHfvHoDceVWjRo1CYGAgnJyc0LlzZ9y9excA0KlTJ8TGxsLf3x+ZmZl48eKFOIoVExMDIDfhGjBgAPz9/WFtbV0+naZKgckUERFVeIERMfhoSTAG/HIOU3aEY9UdXay4Z4wnKqbw8PDA4cOHkZiYiF27dkGhUAAAxowZg2HDhqFZs2ZYvnw57OzssHHjRgC58622bNmCH374ATo6OpDL5bCxsYG5ubk4AuXj44OGDRti0KBB5dZvqhyYTBERUYUWGBGDcVvDEJOULtkem5SOcVvDEBgRA0NDQzRo0ACRkZGwsLAAADg4OEjaN2zYULwUCACff/45YmNj8fjxYzx//hx+fn54+vQp6tatCwAIDg7G7t27oaamBjU1NXTu3BkAYGJiAl9f39LsMlUynIBOREQVVo5CwPyDNyAUsE8AIAMw/+ANuFjrIioqCt7e3qhTpw4sLS1x+/ZtSfs7d+6ga9eu+Y5jbm4OANi4cSO0tLTQpUsXAMAff/whKaVw8eJFDB8+HKdPn0a9evVKqotUBTCZIiKiCutCdEK+ESkAeBG8Adq2zlAzMEP0owR06fYNVFVVMWDAAMhkMsycORO+vr5o2rQpPvzwQ2zZsgW3bt3Cnj17xGOsXr0arq6u0NXVRVBQEGbOnInFixfD0NAQAPIlTM+ePQOQO8KV14YIYDJFREQVWHxK/kQKALJTnuHZQX/kvEqGqrYB6ru2wblz52BqagoAmDp1KtLT0zFt2jQkJCSgadOmCAoKkiRIFy5cgK+vL1JTU2Fvb49169bB29u7TPpFVYtMEISCRk+pEMnJyTAwMEBSUhL09fXLOxwioiotJOo5Bvxy7p3tto9qDZd6xmUQEVVWpfn5zQnoRERUYTnbGMHCQAuyQvbLAFgYaMHZxqgswyKSYDJFREQVlqqKDL5euXflvZlQ5T339XKAqkph6RZR6as0ydR3330HV1dX6OjoFDrx78GDB+jevTt0dHRgZmaGmTNnIjs7W9LmxIkTcHJygqamJmxtbbF58+bSD56IiN6bZyMLBAxygtxAS7JdbqCFgEFO8GxkUU6REeWqNBPQMzMz0adPH7i4uGDDhg359ufk5KB79+6Qy+U4e/YsYmJiMHjwYKirq2PhwoUAgOjoaHTv3h1jx47Ftm3bcOzYMYwcORIWFhbw8PAo6y4REVEReTayQBcHOS5EJyA+JR1mermX9jgiRRVBpZuAvnnzZkydOhWJiYmS7X///Tc+/vhjPHnyRKwZsnbtWsyePRtPnz6FhoYGZs+ejb/++gsRERHi6/r374/ExEQEBgYW6f05AZ2IiKjy4QT0IggJCUHjxo3FRAoAPDw8kJycjOvXr4tt3NzcJK/z8PBASEhIocfNyMhAcnKy5EFERESUp8okU7GxsZJECvhfVdvY2Ni3tklOTpZUuX3dokWLYGBgID6srKxKIXoiIiKqrMo1mZozZw5kMtlbH7du3SrPEOHj44OkpCTx8fDhw3KNh4iIiCqWcp2APmPGDAwdOvStbfIWnHwXuVyOCxcuSLbFxcWJ+/L+m7ft9Tb6+vrQ1tYu8LiamprQ1NQsUgxERERU/ZRrMmVqaiqW/leWi4sLvvvuO8THx8PMzAwAEBQUBH19fXHlcBcXFxw+fFjyuqCgILi4uJRIDERERFT9VJo5Uw8ePEB4eDgePHiAnJwchIeHIzw8HKmpqQAAd3d3ODg4wNvbG1euXMGRI0fw9ddfY8KECeLI0tixY3Hv3j3MmjULt27dwk8//YRdu3Zh2rRp5dk1IiIiqsQqTTI1b948NGvWTFyUslmzZmjWrBkuXboEAFBVVcWhQ4egqqoKFxcXDBo0CIMHD8aCBQvEY9jY2OCvv/5CUFAQmjZtih9++AHr169njSkiomrIz88v3zxde3t7SZuQkBB06tQJNWrUgL6+Ptq1aye5YSksLAxdunSBoaEhjI2NMXr0aPFL/pueP3+OWrVqQSaT5SvvQ5VbpaszVd5YZ4qIqGrw8/PDnj17cPToUXGbmpoaTExMAOQmUp6envDx8YGXlxfU1NRw5coV9OjRA5qamnjy5AkaNWqEfv36YerUqUhOTsbUqVNhYWGBPXv25Hu/nj17IjMzE3///TdevHhR6GoeVDpK8/O70lRAJyIiKmlqamriTUpvmjZtGiZPnow5c+aI2+zs7MR/Hzp0COrq6lizZg1UVHIv9KxduxZNmjRBZGQkbG1txbYBAQFITEzEvHnz8Pfff5dSb6i8VJrLfERERCXt7t27sLS0RN26dTFw4EA8ePAAABAfH4/z58/DzMwMrq6uMDc3R/v27XHmzBnxtRkZGdDQ0BATKQDineGvt7tx4wYWLFiAX3/9VdKWqg7+XyUiomojRyEgJOo5DoQ/hr51Q2zcuAmBgYEICAhAdHQ02rZti5SUFNy7dw9A7qXAUaNGITAwEE5OTujcuTPu3r0LAOjUqRNiY2Ph7++PzMxMvHjxQhzFiomJAZCbcA0YMAD+/v6wtrYun05TqWMyRURE1UJgRAw+WhKMAb+cw5Qd4Vh1Rxcr7hnjiYopPDw8cPjwYSQmJmLXrl1QKBQAgDFjxmDYsGFo1qwZli9fDjs7O2zcuBEA4OjoiC1btuCHH36Ajo4O5HI5bGxsYG5uLo5A+fj4oGHDhhg0aFC59ZtKH5MpIiKq8gIjYjBuaxhiktIl22OT0jFuaxgCI2JgaGiIBg0aIDIyEhYWFgAg1inM07BhQ/FSIAB8/vnniI2NxePHj/H8+XP4+fnh6dOnYsHp4OBg7N69G2pqalBTU0Pnzp0BACYmJvD19S3NLlMZ4gR0IiKq0nIUAuYfvIGCbl0XAMgAzD94Ay7WuoiKioK3tzfq1KkDS0tL3L59W9L+zp076Nq1a77j5K37unHjRmhpaaFLly4AgD/++ENSSuHixYsYPnw4Tp8+jXr16pVUF6mcMZkiIqIq7UJ0Qr4RKQB4EbwB2rbOUDMwQ/SjBHTp9g1UVVUxYMAAyGQyzJw5E76+vmjatCk+/PBDbNmyBbdu3ZKUPVi9ejVcXV2hq6uLoKAgzJw5E4sXLxbLHryZMD179gxA7ggXSyNUHUymiIioSotPyZ9IAUB2yjM8O+iPnFfJUNU2QH3XNjh37py4zNnUqVORnp6OadOmISEhAU2bNkVQUJAkQbpw4YJYTNre3h7r1q2Dt7d3mfSLKg4W7SwmFu0kIqpcQqKeY8Av597Zbvuo1nCpZ1wGEVF5KM3Pb05AJyKiKs3ZxggWBlqQFbJfBsDCQAvONkZlGRZVIUymiIioSlNVkcHXK/euvDcTqrznvl4OUFUpLN0iejsmU5VMTk4O5s6dCxsbG2hra6NevXr45ptvUNjV2rFjx0Imk2HFihVlGygRUQXi2cgCAYOcIDfQkmyXG2ghYJATPBtZlFNkVBVwAnols2TJEgQEBGDLli1wdHTEpUuXMGzYMBgYGGDy5MmStvv27cO5c+dgaWlZTtESEVUcno0s0MVBjgvRCYhPSYeZXu6lPY5IkbKYTFUyZ8+eRY8ePdC9e3cAQJ06dbB9+3ZcuHBB0u7x48eYNGkSjhw5IrYlIqruVFVknGROJY6X+SoZV1dXHDt2DHfu3AEAXLlyBWfOnJEUkVMoFPD29sbMmTPh6OhYXqESERFVCxyZqgRyFII4LN2+zygkJiXB3t4eqqqqyMnJwXfffYeBAweK7ZcsWQI1NbV8l/2IiIio5DGZquACI2Iw/+ANsXpv2o2TSD61GbOWrMFAz48QHh6OqVOnwtLSEkOGDEFoaChWrlyJsLAwyGScB0BERFTaeJmvAitoYc4XJzZB17k3dj63xmOZCby9vTFt2jQsWrQIAHD69GnEx8fD2tpaXFjzv//+w4wZM1CnTp1y6gkREVHVxZGpCqqwhTmFrAxAlpsDzz94A10c5FBVVYVCoQAAeHt7w83NTfIaDw8PeHt7Y9iwYWUROhERUbXCZKqCKmxhTm1bZySd3QlVfVM8NLGG/7rfsGzZMgwfPhwAYGxsDGNj6Z0q6urqkMvlsLOzK5PYiYiIqhMmUxVUYQtzGrmNQeLprUj45ycoXiZhhdwCY8aMwbx588o4QiIiIgKYTFVYZnpaBW5X0dSBkdtoGLmNBlC0hTnv379f0uERERHR/+ME9AqKC3MSERFVDkymKiguzElERFQ5MJmqwLgwJxERUcXHOVMVHBfmJCIiqtiYTFUCXJiTiIio4uJlPiIiIiIlMJkiIiIiUgKTKSIiIiIlMJkiIiIiUgKTKSIiIiIlMJkiIiIiUgKTKSIiIiIlMJkiIiIiUgKTKXqrnJwczJ07FzY2NtDW1ka9evXwzTffQBCEAtuPHTsWMpkMK1asKNtAiYiIygkroNNbLVmyBAEBAdiyZQscHR1x6dIlDBs2DAYGBpg8ebKk7b59+3Du3DlYWlqWU7RERERlj8kUvdXZs2fRo0cPdO/eHQBQp04dbN++HRcuXJC0e/z4MSZNmoQjR46IbYmIiKoDXuajt3J1dcWxY8dw584dAMCVK1dw5swZdO3aVWyjUCjg7e2NmTNnwtHRsbxCJSIiKhccmaJ8chQCLkQnID4lHe37jEJiUhLs7e2hqqqKnJwcfPfddxg4cKDYfsmSJVBTU8t32Y+IiKg6YDJFEoERMZh/8AZiktIBAGk3TiL51GbMWrIGAz0/Qnh4OKZOnQpLS0sMGTIEoaGhWLlyJcLCwiCTyco5eiIiorLHy3wkCoyIwbitYWIiBQAvTmyCrnNv7HxujccyE3h7e2PatGlYtGgRAOD06dOIj4+HtbU11NTUoKamhv/++w8zZsxAnTp1yqknREREZYcjUwQg99Le/IM38GbBAyErA5Dl5tzzD95AFwc5VFVVoVAoAADe3t5wc3OTvMbDwwPe3t4YNmxYWYRORERUrirNyNR3330HV1dX6OjowNDQsMA2Mpks32PHjh2SNidOnICTkxM0NTVha2uLzZs3l37wlcCF6ATJiFQebVtnJJ3dibSoi3j44D/4r/sNy5Ytw6effgoAMDY2RqNGjSQPdXV1yOVy2NnZlXU3iIiIylylGZnKzMxEnz594OLigg0bNhTabtOmTfD09BSfv554RUdHo3v37hg7diy2bduGY8eOYeTIkbCwsICHh0dphl/hxafkT6QAwMhtDBJPb0XCPz9B8TIJK+QWGDNmDObNm1fGERIREVVMlSaZmj9/PgC8cyTJ0NAQcrm8wH1r166FjY0NfvjhBwBAw4YNcebMGSxfvrzaJ1NmeloFblfR1IGR22gYuY0GAGwf1Rou9Yzfeqz79++XdHhEREQVVqW5zFdUEyZMgImJCZydnbFx40bJsichISEFzu8JCQkp9HgZGRlITk6WPKoiZxsjWBhoobD78WQALAy04GxjVJZhERERVXhVKplasGABdu3ahaCgIPTu3Rvjx4/Hjz/+KO6PjY2Fubm55DXm5uZITk7Gq1evCjzmokWLYGBgID6srKxKtQ/lRVVFBl8vBwDIl1DlPff1coCqCssfEBERva5ck6k5c+YUOGn89cetW7eKfLy5c+eiTZs2aNasGWbPno1Zs2bB399fqRh9fHyQlJQkPh4+fKjU8Soyz0YWCBjkBLmB9JKf3EALAYOc4NnIopwiIyIiqrjKdc7UjBkzMHTo0Le2qVu37nsfv1WrVvjmm2+QkZEBTU1NyOVyxMXFSdrExcVBX18f2traBR5DU1MTmpqa7x1DZePZyAJdHORiBXQzvdxLexyRIiIiKli5JlOmpqYwNTUtteOHh4ejZs2aYjLk4uKCw4cPS9oEBQXBxcWl1GKojFRVZO+cZE5ERES5Ks3dfA8ePEBCQgIePHiAnJwchIeHAwBsbW2hq6uLgwcPIi4uDq1bt4aWlhaCgoKwcOFCfPHFF+Ixxo4di9WrV2PWrFkYPnw4goODsWvXLvz111/l1CsiIiKq7GTC67e7VWBDhw7Fli1b8m0/fvw4OnTogMDAQPj4+CAyMhKCIMDW1hbjxo3DqFGjoKLyv6lhJ06cwLRp03Djxg3UqlULc+fOfeelxtclJyfDwMAASUlJ0NfXL4muERERUSkrzc/vSpNMVRRMpoiIiCqf0vz8rlKlEYiIiIjKGpMpIiIiIiUwmSIiIiJSApMpIiIiIiUwmSIiIiJSApMpIiIiIiVUmqKdFUVeJYnk5ORyjoSIiIiKKu9zuzQqQjGZKqaUlBQAgJWVVTlHQkRERMWVkpICAwODEj0mi3YWk0KhwJMnT6CnpweZrOos/pucnAwrKys8fPiQxUgLwXP0bjxH78Zz9G48R+/Gc/Rub54jQRCQkpICS0tLycooJYEjU8WkoqKCWrVqlXcYpUZfX5+/mO/Ac/RuPEfvxnP0bjxH78Zz9G6vn6OSHpHKwwnoREREREpgMkVERESkBCZTBADQ1NSEr68vNDU1yzuUCovn6N14jt6N5+jdeI7ejefo3cryHHECOhEREZESODJFREREpAQmU0RERERKYDJFREREpAQmU0RERERKYDJVzXz33XdwdXWFjo4ODA0NC2zz4MEDdO/eHTo6OjAzM8PMmTORnZ0taXPixAk4OTlBU1MTtra22Lx5c+kHX47q1KkDmUwmeSxevFjS5urVq2jbti20tLRgZWWF77//vpyiLR9r1qxBnTp1oKWlhVatWuHChQvlHVK58fPzy/fzYm9vL+5PT0/HhAkTYGxsDF1dXfTu3RtxcXHlGHHpO3XqFLy8vGBpaQmZTIb9+/dL9guCgHnz5sHCwgLa2tpwc3PD3bt3JW0SEhIwcOBA6Ovrw9DQECNGjEBqamoZ9qJ0vescDR06NN/Plaenp6RNVT9HixYtQsuWLaGnpwczMzP07NkTt2/flrQpyu9XUT7nioPJVDWTmZmJPn36YNy4cQXuz8nJQffu3ZGZmYmzZ89iy5Yt2Lx5M+bNmye2iY6ORvfu3dGxY0eEh4dj6tSpGDlyJI4cOVJW3SgXCxYsQExMjPiYNGmSuC85ORnu7u6oXbs2QkND4e/vDz8/P/z888/lGHHZ2blzJ6ZPnw5fX1+EhYWhadOm8PDwQHx8fHmHVm4cHR0lPy9nzpwR902bNg0HDx7E7t27cfLkSTx58gS9evUqx2hLX1paGpo2bYo1a9YUuP/777/HqlWrsHbtWpw/fx41atSAh4cH0tPTxTYDBw7E9evXERQUhEOHDuHUqVMYPXp0WXWh1L3rHAGAp6en5Odq+/btkv1V/RydPHkSEyZMwLlz5xAUFISsrCy4u7sjLS1NbPOu36+ifM4Vm0DV0qZNmwQDA4N82w8fPiyoqKgIsbGx4raAgABBX19fyMjIEARBEGbNmiU4OjpKXtevXz/Bw8OjVGMuT7Vr1xaWL19e6P6ffvpJqFmzpniOBEEQZs+eLdjZ2ZVBdOXP2dlZmDBhgvg8JydHsLS0FBYtWlSOUZUfX19foWnTpgXuS0xMFNTV1YXdu3eL227evCkAEEJCQsoowvIFQNi3b5/4XKFQCHK5XPD39xe3JSYmCpqamsL27dsFQRCEGzduCACEixcvim3+/vtvQSaTCY8fPy6z2MvKm+dIEARhyJAhQo8ePQp9TXU7R4IgCPHx8QIA4eTJk4IgFO33qyifc8XFkSmSCAkJQePGjWFubi5u8/DwQHJyMq5fvy62cXNzk7zOw8MDISEhZRprWVu8eDGMjY3RrFkz+Pv7S4aEQ0JC0K5dO2hoaIjbPDw8cPv2bbx48aI8wi0zmZmZCA0NlfxMqKiowM3Nrcr/TLzN3bt3YWlpibp162LgwIF48OABACA0NBRZWVmS82Vvbw9ra+tqe76io6MRGxsrOScGBgZo1aqVeE5CQkJgaGiIFi1aiG3c3NygoqKC8+fPl3nM5eXEiRMwMzODnZ0dxo0bh+fPn4v7quM5SkpKAgAYGRkBKNrvV1E+54qLCx2TRGxsrOQHDID4PDY29q1tkpOT8erVK2hra5dNsGVo8uTJcHJygpGREc6ePQsfHx/ExMRg2bJlAHLPiY2NjeQ1r5+3mjVrlnnMZeXZs2fIyckp8Gfi1q1b5RRV+WrVqhU2b94MOzs7xMTEYP78+Wjbti0iIiIQGxsLDQ2NfHMWzc3Nxd+x6iav3wX9DL3+d8fMzEyyX01NDUZGRtXmvHl6eqJXr16wsbFBVFQUvvzyS3Tt2hUhISFQVVWtdudIoVBg6tSpaNOmDRo1agQARfr9KsrnXHExmaoC5syZgyVLlry1zc2bNyUTYKl452369OnitiZNmkBDQwNjxozBokWLuJwD5dO1a1fx302aNEGrVq1Qu3Zt7Nq1q0p+2aCy0b9/f/HfjRs3RpMmTVCvXj2cOHECnTt3LsfIyseECRMQEREhmY9YXphMVQEzZszA0KFD39qmbt26RTqWXC7PdxdW3l0Qcrlc/O+bd0bExcVBX1+/Un1QKHPeWrVqhezsbNy/fx92dnaFnhPgf+etqjIxMYGqqmqB/a/qfS8qQ0NDNGjQAJGRkejSpQsyMzORmJgo+fZcnc9XXr/j4uJgYWEhbo+Li8OHH34otnnzhobs7GwkJCRU2/NWt25dmJiYIDIyEp07d65W52jixIniBPtatWqJ2+Vy+Tt/v4ryOVdcnDNVBZiamsLe3v6tj9fn8ryNi4sLrl27JvmFDAoKgr6+PhwcHMQ2x44dk7wuKCgILi4uJdepMqDMeQsPD4eKioo4pO7i4oJTp04hKytLbBMUFAQ7O7sqfYkPADQ0NNC8eXPJz4RCocCxY8cq3c9EaUlNTUVUVBQsLCzQvHlzqKurS87X7du38eDBg2p7vmxsbCCXyyXnJDk5GefPnxfPiYuLCxITExEaGiq2CQ4OhkKhQKtWrco85org0aNHeP78uZiAVodzJAgCJk6ciH379iE4ODjf9Iqi/H4V5XPufQKjauS///4TLl++LMyfP1/Q1dUVLl++LFy+fFlISUkRBEEQsrOzhUaNGgnu7u5CeHi4EBgYKJiamgo+Pj7iMe7duyfo6OgIM2fOFG7evCmsWbNGUFVVFQIDA8urW6Xq7NmzwvLly4Xw8HAhKipK2Lp1q2BqaioMHjxYbJOYmCiYm5sL3t7eQkREhLBjxw5BR0dHWLduXTlGXnZ27NghaGpqCps3bxZu3LghjB49WjA0NJTcLVOdzJgxQzhx4oQQHR0t/Pvvv4Kbm5tgYmIixMfHC4IgCGPHjhWsra2F4OBg4dKlS4KLi4vg4uJSzlGXrpSUFPHvDQBh2bJlwuXLl4X//vtPEARBWLx4sWBoaCgcOHBAuHr1qtCjRw/BxsZGePXqlXgMT09PoVmzZsL58+eFM2fOCPXr1xcGDBhQXl0qcW87RykpKcIXX3whhISECNHR0cLRo0cFJycnoX79+kJ6erp4jKp+jsaNGycYGBgIJ06cEGJiYsTHy5cvxTbv+v0qyudccTGZqmaGDBkiAMj3OH78uNjm/v37QteuXQVtbW3BxMREmDFjhpCVlSU5zvHjx4UPP/xQ0NDQEOrWrSts2rSpbDtShkJDQ4VWrVoJBgYGgpaWltCwYUNh4cKFkj9ggiAIV65cET766CNBU1NT+OCDD4TFixeXU8Tl48cffxSsra0FDQ0NwdnZWTh37lx5h1Ru+vXrJ1hYWAgaGhrCBx98IPTr10+IjIwU97969UoYP368ULNmTUFHR0f49NNPhZiYmHKMuPQdP368wL89Q4YMEQQhtzzC3LlzBXNzc0FTU1Po3LmzcPv2bckxnj9/LgwYMEDQ1dUV9PX1hWHDholfBKuCt52jly9fCu7u7oKpqamgrq4u1K5dWxg1alS+LyxV/RwVdH4ASD6DivL7VZTPueKQ/X9wRERERPQeOGeKiIiISAlMpoiIiIiUwGSKiIiISAlMpoiIiIiUwGSKiIiISAlMpoiIiIiUwGSKiIiISAlMpoiIiIiUwGSKiCTq1KmDFStWlNjxhg4dip49e5bY8QDgxIkTkMlkSExMLNHjEhG9DyZTRFXU0KFDIZPJIJPJoKGhAVtbWyxYsADZ2dlvfd3FixcxevToEotj5cqV2Lx5c4kdrzguX76MPn36wNzcHFpaWqhfvz5GjRqFO3fulEs8FVVRE+iff/4ZHTp0gL6+PpNZotcwmSKqwjw9PRETE4O7d+9ixowZ8PPzg7+/f4FtMzMzAQCmpqbQ0dEpsRgMDAxgaGhYYscrqkOHDqF169bIyMjAtm3bcPPmTWzduhUGBgaYO3dumcdTFbx8+RKenp748ssvyzsUoorlvVf1I6IKbciQIUKPHj0k27p06SK0bt1asv/bb78VLCwshDp16giCIAi1a9cWli9fLr4GgPDLL78IPXv2FLS1tQVbW1vhwIEDkuNGREQI3bt3F/T09ARdXV3ho48+Ehf2fTOO9u3bCxMmTBAmTJgg6OvrC8bGxsLXX38tKBQKsc2vv/4qNG/eXNDV1RXMzc2FAQMGCHFxceL+vAVhX7x4UWDf09LSBBMTE6Fnz54F7n/9dSdOnBBatmwpaGhoCHK5XJg9e7ZkwdP27dsLEydOFKZMmSIYGhoKZmZmws8//yykpqYKQ4cOFXR1dYV69eoJhw8fzhffoUOHhMaNGwuamppCq1athGvXrkni2LNnj+Dg4CBoaGgItWvXFpYuXSrZX7t2beG7774Thg0bJujq6gpWVlbCunXrJG0ePHgg9OnTRzAwMBBq1qwpfPLJJ0J0dLS4P+/8+/v7C3K5XDAyMhLGjx8vZGZmiv3DG4vGvsu7zj9RdcORKaJqRFtbWxyBAoBjx47h9u3bCAoKwqFDhwp93fz589G3b19cvXoV3bp1w8CBA5GQkAAAePz4Mdq1awdNTU0EBwcjNDQUw4cPf+vlxC1btkBNTQ0XLlzAypUrsWzZMqxfv17cn5WVhW+++QZXrlzB/v37cf/+fQwdOrTI/Txy5AiePXuGWbNmFbg/b6Ts8ePH6NatG1q2bIkrV64gICAAGzZswLfffpsvXhMTE1y4cAGTJk3CuHHj0KdPH7i6uiIsLAzu7u7w9vbGy5cvJa+bOXMmfvjhB1y8eBGmpqbw8vJCVlYWACA0NBR9+/ZF//79ce3aNfj5+WHu3Ln5Lon+8MMPaNGiBS5fvozx48dj3LhxuH37tniePDw8oKenh9OnT+Pff/+Frq4uPD09Jf+fjx8/jqioKBw/fhxbtmzB5s2bxffZu3cvatWqhQULFiAmJgYxMTFFPs9E9P/KO5sjotLx+oiQQqEQgoKCBE1NTeGLL74Q95ubmwsZGRmS1xU0MvX111+Lz1NTUwUAwt9//y0IgiD4+PgINjY24kjH2+IQhNyRkIYNG0pGombPni00bNiw0L5cvHhRACCkpKQIgvDukZElS5YIAISEhIRCjykIgvDll18KdnZ2kljWrFkj6OrqCjk5OWK8H330kbg/OztbqFGjhuDt7S1ui4mJEQAIISEhkvh27Nghtnn+/Lmgra0t7Ny5UxAEQfj888+FLl26SOKZOXOm4ODgID6vXbu2MGjQIPG5QqEQzMzMhICAAEEQBOG3337LF39GRoagra0tHDlyRBCE3PNfu3ZtITs7W2zTp08foV+/fpL3ef3/+btwZIpIiiNTRFXYoUOHoKurCy0tLXTt2hX9+vWDn5+fuL9x48bQ0NB453GaNGki/rtGjRrQ19dHfHw8ACA8PBxt27aFurp6keNq3bo1ZDKZ+NzFxQV3795FTk4OgNxRGy8vL1hbW0NPTw/t27cHADx48KBIxxcEoUjtbt68CRcXF0ksbdq0QWpqKh49eiRue73/qqqqMDY2RuPGjcVt5ubmACCek9f7lcfIyAh2dna4efOm+N5t2rSRtG/Tpo3kPLz53jKZDHK5XHyfK1euIDIyEnp6etDV1YWuri6MjIyQnp6OqKgo8XWOjo5QVVUVn1tYWOSLlYjen1p5B0BEpadjx44ICAiAhoYGLC0toaYm/ZWvUaNGkY7zZqIkk8mgUCgA5F46LElpaWnw8PCAh4cHtm3bBlNTUzx48AAeHh6SS1dv06BBAwDArVu3JAnN+yqo/69vy0vG8s5JSXrbuU9NTUXz5s2xbdu2fK8zNTUt0jGISHkcmSKqwmrUqAFbW1tYW1vnS6RKSpMmTXD69GlxLlBRnD9/XvL83LlzqF+/PlRVVXHr1i08f/4cixcvRtu2bWFvb1/sURR3d3eYmJjg+++/L3B/3i39DRs2REhIiGQk699//4Wenh5q1apVrPcsyLlz58R/v3jxAnfu3EHDhg3F9/73338l7f/99180aNBAMor0Nk5OTrh79y7MzMxga2sreRgYGBQ5Tg0NDcloGBEVD5MpIlLKxIkTkZycjP79++PSpUu4e/cufvvtN3GSdEEePHiA6dOn4/bt29i+fTt+/PFHTJkyBQBgbW0NDQ0N/Pjjj7h37x7+/PNPfPPNN8WKqUaNGli/fj3++usvfPLJJzh69Cju37+PS5cuYdasWRg7diwAYPz48Xj48CEmTZqEW7du4cCBA/D19cX06dOhoqL8n8cFCxbg2LFjiIiIwNChQ2FiYiIWMJ0xYwaOHTuGb775Bnfu3MGWLVuwevVqfPHFF0U+/sCBA2FiYoIePXrg9OnTiI6OxokTJzB58mTJZcp3qVOnDk6dOoXHjx/j2bNnhbaLjY1FeHg4IiMjAQDXrl1DeHi4eDMCUXXFZIqIlGJsbIzg4GCkpqaiffv2aN68OX755Ze3zqEaPHgwXr16BWdnZ0yYMAFTpkwRC4Wamppi8+bN2L17NxwcHLB48WIsXbq02HH16NEDZ8+ehbq6Oj7//HPY29tjwIABSEpKEu/W++CDD3D48GFcuHABTZs2xdixYzFixAh8/fXX73cy3rB48WJMmTIFzZs3R2xsLA4ePCjOUXNycsKuXbuwY8cONGrUCPPmzcOCBQuKddeijo4OTp06BWtra/Tq1QsNGzbEiBEjkJ6eDn19/SIfZ8GCBbh//z7q1asnuTz4prVr16JZs2YYNWoUAKBdu3Zo1qwZ/vzzzyK/F1FVJBOKOlOTiKgEdOjQAR9++GGJLllT0Zw4cQIdO3bEixcvyqVgKRGVLY5MERERESmByRQRERGREniZj4iIiEgJHJkiIiIiUgKTKSIiIiIlMJkiIiIiUgKTKSIiIiIlMJkiIiIiUgKTKSIiIiIlMJkiIiIiUgKTKSIiIiIl/B/YrfUA6jD4qgAAAABJRU5ErkJggg==\n",
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
}
],
"source": [
"import matplotlib.pyplot as plt\n",
"fig, ax = plt.subplots()\n",
"ax.scatter(principalComponents[:, 0], principalComponents[:, 1])\n",
"\n",
"for i, spkid in enumerate(labels):\n",
" ax.annotate(spkid, (principalComponents[i, 0], principalComponents[i, 1]))\n",
"plt.xlabel(\"Principal Component 1\")\n",
"plt.ylabel(\"Principal Component 2\")"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "rDfkPAUA_JUk"
},
"source": [
"Given the embeddings computed with the ECAPA-TDNN model, we can perform speaker verification in this way:"
]
},
{
"cell_type": "code",
"execution_count": 12,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"executionInfo": {
"elapsed": 3166,
"status": "ok",
"timestamp": 1706105755778,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "KuWnaG-j_Tr3",
"outputId": "7d6c1ac5-d9aa-4438-cf49-9bd2ba883fec"
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"tensor([0.6952]) tensor([True])\n",
"tensor([0.0159]) tensor([False])\n"
]
}
],
"source": [
"# Different files from the same speaker\n",
"file1 = './LibriSpeech/dev-clean-2/1272/135031/1272-135031-0000.flac' # Same speaker\n",
"file2 = './LibriSpeech/dev-clean-2/1272/141231/1272-141231-0004.flac' # Same speaker\n",
"file3 = './LibriSpeech/dev-clean-2/1462/170142/1462-170142-0000.flac' # Different speaker\n",
"\n",
"# Test with 2 files from the same speaker\n",
"score, prediction = verification.verify_files(file1, file2)\n",
"print(score, prediction)\n",
"\n",
"# Test with 2 files from different speakers\n",
"score, prediction = verification.verify_files(file1, file3)\n",
"print(score, prediction)"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "VSax2FUVBiRu"
},
"source": [
"LibriSpeech is a very easy task for speaker verification. However, the ECAPA model works very well on other types of data. With voxceleb, we achieved an Equal Error Rate of 0.69%. Feel free to record yourself (with a sampling rate of 16 kHz) and play with that!"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "2AV_AknNQebh"
},
"source": [
"### Source Separation"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "OFiEZitTaxcx"
},
"source": [
"What about Source Separation ?\n",
"A pretrained SepFormer model is available [here]:(https://huggingface.co/speechbrain/sepformer-wsj02mix). It can be used right out off the box to perform separation on clean speech mixtures.\n"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "08KQG5rVQkaA"
},
"source": [
"We create an artificial mixture here by mixing together two utterances from MiniLibriSpeech."
]
},
{
"cell_type": "code",
"execution_count": 13,
"metadata": {
"executionInfo": {
"elapsed": 172,
"status": "ok",
"timestamp": 1706105755780,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "SyEQ3QmmQR3H"
},
"outputs": [],
"source": [
"import torchaudio\n",
"s1, fs = torchaudio.load('./LibriSpeech/dev-clean-2/1272/135031/1272-135031-0003.flac')\n",
"s2, fs = torchaudio.load('./LibriSpeech/dev-clean-2/1462/170142/1462-170142-0001.flac')\n",
"\n",
"# we resample because we will use a model trained on 8KHz data.\n",
"resampler = torchaudio.transforms.Resample(fs, 8000)\n",
"s1 = resampler(s1)\n",
"s2 = resampler(s2)\n",
"fs= 8000\n",
"\n",
"min_len = min(s1.shape[-1], s2.shape[-1])\n",
"s1 = s1[:, :min_len]\n",
"s2 = s2[:, :min_len]\n",
"mix = s1 + s2"
]
},
{
"cell_type": "code",
"execution_count": 14,
"metadata": {
"executionInfo": {
"elapsed": 131,
"status": "ok",
"timestamp": 1706105755783,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "1jBzCNMtRbdJ"
},
"outputs": [],
"source": [
"import IPython.display as ipd"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "d6MI6Xb5-9nu"
},
"source": [
"We can listen to this artificial mixture."
]
},
{
"cell_type": "code",
"execution_count": 15,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/",
"height": 73
},
"executionInfo": {
"elapsed": 109,
"status": "ok",
"timestamp": 1706105755784,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "FzJXPO9LXIKy",
"outputId": "033a197f-8946-4e9d-9947-7cfb60bb17fa"
},
"outputs": [
{
"data": {
"text/html": [
"\n",
" \n",
" "
],
"text/plain": [
""
]
},
"execution_count": 15,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"ipd.Audio(mix[0], rate=fs)"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "LTuaNzcG_DGX"
},
"source": [
"Now, we can instantiate the pretrained SepFormer from
[HuggingFace](https://huggingface.co/models)
."
]
},
{
"cell_type": "code",
"execution_count": 16,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/",
"height": 166,
"referenced_widgets": [
"e625e51535634cb88f89f93c1b95a5b8",
"b7ff251217dc4a31abd29db0d8ddb8ee",
"6e88d9cddfae4c0585a030628f415163",
"5a4bb7e698db43ab98cf5e3cad123eff",
"d37c1933e8a24a11ae9a2b3180e53309",
"c65d659414184d6bbf896b581177e1a4",
"f92e99fc7682436a85d11ec2f115e206",
"7a59681cc6884eeb90cad0ad810eb340",
"5dcb9b7c948c42a6afb63bd89664744f",
"16f0ca4e8c1944a1a1e90b5484f9a270",
"8c5f52ed4b7042df8bb636e73c702d64",
"f6739e26b4de4cb8b3d9e3f62876325f",
"f52c23a438e2415cb4632ae276299cc4",
"94ac439a7b2344acb89dd968f4832d24",
"16c602c5ca4b42d5a22e97249dbc8316",
"ea33a83bcbbc4ba5a983712f1d197e17",
"6b3edbd6a47b4b3982ab30870d853199",
"8c9d3cdb6d9248129db49203fb4df0ec",
"2961959a379f4934b2f47f3ec99736cd",
"d439ae84c3cd41f0b89eaa7c32ba310e",
"a9ede27dcd6c4c17aad2e03976788ac8",
"1791bf4e7a7f4f7aa03bb9c420f2c3af",
"00b563eeca124124bc81f8f19a5f0e48",
"86b24bfbc04d4bda8cce53a140c17e62",
"4ef78f63daba4f20a768e58c023a8eee",
"daaf30a442cb4fb48db9a082a40c6376",
"6b302652bec7427680692afe5c3630f9",
"78cfac8bcaea470ebfba4104154cec3d",
"d9b66e1b93fb4664beeadcf100a43232",
"6d597a48192e436f89b71fd1b18a37fb",
"bd7023fc26be4623ab2c0e98b242ea1a",
"2afeeaed1b344835bc0cd7a3f16add8e",
"ccd1e7c8a24f4a5e90875d85ca2cf6a3",
"9a755c6dcb464a4c91ba4443ea9d30d9",
"0c1d9a4d91eb4f0397bc17c1abeafcd6",
"5bcd65e2cc574d428cf8fa49207b1d0f",
"e600eb9e6fb74c35b3015ac6d56b5b90",
"89f354d3bb7d40a9ba8b106071802006",
"9b1b16de38574725bcbf9527f77b8820",
"c81777f5d3814ced8096613714f3d054",
"3461887798324f60993c526e21a197ff",
"1bcc055f1b474119bb9b734939340767",
"0d4c194f09524aac95e602a14d9a485d",
"1d4f4e45172e432a9a6a9e2545b87e6b"
]
},
"executionInfo": {
"elapsed": 1860,
"status": "ok",
"timestamp": 1706105757564,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "8Fmt65bJS1X4",
"outputId": "bf07934e-2d55-43b8-c8e7-b7e1b6cb7d6f"
},
"outputs": [
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "e625e51535634cb88f89f93c1b95a5b8",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"hyperparams.yaml: 0%| | 0.00/1.51k [00:00, ?B/s]"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "f6739e26b4de4cb8b3d9e3f62876325f",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"masknet.ckpt: 0%| | 0.00/113M [00:00, ?B/s]"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "00b563eeca124124bc81f8f19a5f0e48",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"encoder.ckpt: 0%| | 0.00/17.3k [00:00, ?B/s]"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "9a755c6dcb464a4c91ba4443ea9d30d9",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"decoder.ckpt: 0%| | 0.00/17.2k [00:00, ?B/s]"
]
},
"metadata": {},
"output_type": "display_data"
}
],
"source": [
"from speechbrain.inference.separation import SepformerSeparation\n",
"separator = SepformerSeparation.from_hparams(source=\"speechbrain/sepformer-wsj02mix\", savedir=\"./pretrained_sepformer\")"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "UfLzNQuhAh9A"
},
"source": [
"and we use it to separate the mixture"
]
},
{
"cell_type": "code",
"execution_count": 17,
"metadata": {
"executionInfo": {
"elapsed": 12228,
"status": "ok",
"timestamp": 1706105769765,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "4CHfWcBTTJhZ"
},
"outputs": [],
"source": [
"est_sources = separator.separate_batch(mix)"
]
},
{
"cell_type": "code",
"execution_count": 18,
"metadata": {
"executionInfo": {
"elapsed": 103,
"status": "ok",
"timestamp": 1706105769766,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "E-IfDAtiWUcp"
},
"outputs": [],
"source": [
"est_sources = est_sources[0] # strip batch dimension"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "rvI-xbleAvSj"
},
"source": [
"You can listen at the results here:"
]
},
{
"cell_type": "code",
"execution_count": 19,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/",
"height": 73
},
"executionInfo": {
"elapsed": 77,
"status": "ok",
"timestamp": 1706105769767,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "H6W0qE5OX_v4",
"outputId": "1089bfd8-15d9-429a-cd77-d34f7ec4e9dc"
},
"outputs": [
{
"data": {
"text/html": [
"\n",
" \n",
" "
],
"text/plain": [
""
]
},
"execution_count": 19,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"ipd.Audio(est_sources[:, 0], rate=fs)"
]
},
{
"cell_type": "code",
"execution_count": 20,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/",
"height": 73
},
"executionInfo": {
"elapsed": 63,
"status": "ok",
"timestamp": 1706105769767,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "m-GMA0Q7YA62",
"outputId": "9c698565-da04-43fb-d50f-63603afaea12"
},
"outputs": [
{
"data": {
"text/html": [
"\n",
" \n",
" "
],
"text/plain": [
""
]
},
"execution_count": 20,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"ipd.Audio(est_sources[:, 1], rate=fs)"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "N_0v7Ougbgcm"
},
"source": [
"## Fine-tuning or using pretrained models as components of a new pipeline"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "RnrPT0GuA03w"
},
"source": [
"Here we will show how to fine-tune the CRDNN Encoder Decoder Seq2Seq model used to transcribe the audio in the previous example and downloaded from [here](https://huggingface.co/speechbrain/asr-crdnn-rnnlm-librispeech/blob/main/hyperparams.yaml).\n",
"\n",
"\n",
"\n",
"\n"
]
},
{
"cell_type": "code",
"execution_count": 21,
"metadata": {
"executionInfo": {
"elapsed": 6038,
"status": "ok",
"timestamp": 1706105775747,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "ARD9PaEpE4oD"
},
"outputs": [],
"source": [
"from speechbrain.inference.ASR import EncoderDecoderASR\n",
"asr_model = EncoderDecoderASR.from_hparams(source=\"speechbrain/asr-crdnn-rnnlm-librispeech\", savedir=\"./pretrained_ASR\", hparams_file=\"hyperparams_develop.yaml\")"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "fuuMQdb4ExyP"
},
"source": [
"First we can see that the pretrained `asr_model` allows to access easily all its components:\n"
]
},
{
"cell_type": "code",
"execution_count": 22,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"executionInfo": {
"elapsed": 185,
"status": "ok",
"timestamp": 1706105775749,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "q7c1qywYHkOo",
"outputId": "464933f1-ca5c-435a-fe26-675f1894da29"
},
"outputs": [
{
"data": {
"text/plain": [
"odict_keys(['normalizer', 'encoder', 'decoder', 'lm_model'])"
]
},
"execution_count": 22,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"asr_model.mods.keys()"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "F5d9JG94JBLs"
},
"source": [
"These keys corresponds to the modules entry specified in the [hyperparameter file](https://huggingface.co/speechbrain/asr-crdnn-rnnlm-librispeech/blob/main/hyperparams.yaml):\n",
"\n",
"\n",
"```yaml\n",
"modules:\n",
" encoder: !ref \n",
" decoder: !ref \n",
" lm_model: !ref \n",
"```"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "KNbCyQHIJYKx"
},
"source": [
"We can also see that the encoder is actually composed of several sub-modules:\n",
"\n",
"```yaml\n",
"encoder: !new:speechbrain.nnet.containers.LengthsCapableSequential\n",
" input_shape: [null, null, !ref ]\n",
" compute_features: !ref \n",
" normalize: !ref \n",
" model: !ref \n",
"```\n",
"\n"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "bR6c1k20J3SN"
},
"source": [
"These are simply accessible as members of the encoder:"
]
},
{
"cell_type": "code",
"execution_count": 23,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"executionInfo": {
"elapsed": 175,
"status": "ok",
"timestamp": 1706105775752,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "S6Vwi7cNI7eq",
"outputId": "dbf05273-283a-4a8f-89fa-fdb3a08ca65c"
},
"outputs": [
{
"data": {
"text/plain": [
"LengthsCapableSequential(\n",
" (compute_features): Fbank(\n",
" (compute_STFT): STFT()\n",
" (compute_fbanks): Filterbank()\n",
" (compute_deltas): Deltas()\n",
" (context_window): ContextWindow()\n",
" )\n",
" (normalize): InputNormalization()\n",
" (model): CRDNN(\n",
" (CNN): Sequential(\n",
" (block_0): CNN_Block(\n",
" (conv_1): Conv2d(\n",
" (conv): Conv2d(1, 128, kernel_size=(3, 3), stride=(1, 1))\n",
" )\n",
" (norm_1): LayerNorm(\n",
" (norm): LayerNorm((40, 128), eps=1e-05, elementwise_affine=True)\n",
" )\n",
" (act_1): LeakyReLU(negative_slope=0.01)\n",
" (conv_2): Conv2d(\n",
" (conv): Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1))\n",
" )\n",
" (norm_2): LayerNorm(\n",
" (norm): LayerNorm((40, 128), eps=1e-05, elementwise_affine=True)\n",
" )\n",
" (act_2): LeakyReLU(negative_slope=0.01)\n",
" (pooling): Pooling1d(\n",
" (pool_layer): MaxPool2d(kernel_size=(1, 2), stride=(1, 2), padding=(0, 0), dilation=(1, 1), ceil_mode=False)\n",
" )\n",
" (drop): Dropout2d(\n",
" (drop): Dropout2d(p=0.15, inplace=False)\n",
" )\n",
" )\n",
" (block_1): CNN_Block(\n",
" (conv_1): Conv2d(\n",
" (conv): Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1))\n",
" )\n",
" (norm_1): LayerNorm(\n",
" (norm): LayerNorm((20, 256), eps=1e-05, elementwise_affine=True)\n",
" )\n",
" (act_1): LeakyReLU(negative_slope=0.01)\n",
" (conv_2): Conv2d(\n",
" (conv): Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1))\n",
" )\n",
" (norm_2): LayerNorm(\n",
" (norm): LayerNorm((20, 256), eps=1e-05, elementwise_affine=True)\n",
" )\n",
" (act_2): LeakyReLU(negative_slope=0.01)\n",
" (pooling): Pooling1d(\n",
" (pool_layer): MaxPool2d(kernel_size=(1, 2), stride=(1, 2), padding=(0, 0), dilation=(1, 1), ceil_mode=False)\n",
" )\n",
" (drop): Dropout2d(\n",
" (drop): Dropout2d(p=0.15, inplace=False)\n",
" )\n",
" )\n",
" )\n",
" (time_pooling): Pooling1d(\n",
" (pool_layer): MaxPool2d(kernel_size=(1, 4), stride=(1, 4), padding=(0, 0), dilation=(1, 1), ceil_mode=False)\n",
" )\n",
" (RNN): LSTM(\n",
" (rnn): LSTM(2560, 1024, num_layers=4, batch_first=True, dropout=0.15, bidirectional=True)\n",
" )\n",
" (DNN): Sequential(\n",
" (block_0): DNN_Block(\n",
" (linear): Linear(\n",
" (w): Linear(in_features=2048, out_features=512, bias=True)\n",
" )\n",
" (norm): BatchNorm1d(\n",
" (norm): BatchNorm1d(512, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)\n",
" )\n",
" (act): LeakyReLU(negative_slope=0.01)\n",
" (dropout): Dropout(p=0.15, inplace=False)\n",
" )\n",
" (block_1): DNN_Block(\n",
" (linear): Linear(\n",
" (w): Linear(in_features=512, out_features=512, bias=True)\n",
" )\n",
" (norm): BatchNorm1d(\n",
" (norm): BatchNorm1d(512, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)\n",
" )\n",
" (act): LeakyReLU(negative_slope=0.01)\n",
" (dropout): Dropout(p=0.15, inplace=False)\n",
" )\n",
" )\n",
" )\n",
")"
]
},
"execution_count": 23,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"asr_model.mods.encoder"
]
},
{
"cell_type": "code",
"execution_count": 24,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"executionInfo": {
"elapsed": 138,
"status": "ok",
"timestamp": 1706105775753,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "sgv5daThU1UC",
"outputId": "c28da378-9d26-4dad-808f-3d4be1a4b7f3"
},
"outputs": [
{
"data": {
"text/plain": [
"Fbank(\n",
" (compute_STFT): STFT()\n",
" (compute_fbanks): Filterbank()\n",
" (compute_deltas): Deltas()\n",
" (context_window): ContextWindow()\n",
")"
]
},
"execution_count": 24,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"asr_model.mods.encoder.compute_features"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "hoYbLtZmJ8V6"
},
"source": [
"The training hyperparameters also can be easily accessed:"
]
},
{
"cell_type": "code",
"execution_count": 25,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"executionInfo": {
"elapsed": 86,
"status": "ok",
"timestamp": 1706105775753,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "fBy1ryJ6H2LJ",
"outputId": "b2bcd22a-37e3-48dd-98eb-1df97d9f1a41"
},
"outputs": [
{
"data": {
"text/plain": [
"['__class__',\n",
" '__delattr__',\n",
" '__dict__',\n",
" '__dir__',\n",
" '__doc__',\n",
" '__eq__',\n",
" '__format__',\n",
" '__ge__',\n",
" '__getattribute__',\n",
" '__gt__',\n",
" '__hash__',\n",
" '__init__',\n",
" '__init_subclass__',\n",
" '__le__',\n",
" '__lt__',\n",
" '__ne__',\n",
" '__new__',\n",
" '__reduce__',\n",
" '__reduce_ex__',\n",
" '__repr__',\n",
" '__setattr__',\n",
" '__sizeof__',\n",
" '__str__',\n",
" '__subclasshook__',\n",
" 'activation',\n",
" 'asr_model',\n",
" 'beam_size',\n",
" 'blank_index',\n",
" 'bos_index',\n",
" 'cnn_blocks',\n",
" 'cnn_channels',\n",
" 'cnn_kernelsize',\n",
" 'compute_features',\n",
" 'coverage_penalty',\n",
" 'coverage_scorer',\n",
" 'ctc_lin',\n",
" 'dec',\n",
" 'dec_neurons',\n",
" 'decoder',\n",
" 'dnn_blocks',\n",
" 'dnn_neurons',\n",
" 'dropout',\n",
" 'emb',\n",
" 'emb_size',\n",
" 'enc',\n",
" 'encoder',\n",
" 'eos_index',\n",
" 'eos_threshold',\n",
" 'inter_layer_pooling_size',\n",
" 'lm_model',\n",
" 'lm_weight',\n",
" 'log_softmax',\n",
" 'max_attn_shift',\n",
" 'max_decode_ratio',\n",
" 'min_decode_ratio',\n",
" 'modules',\n",
" 'n_fft',\n",
" 'n_mels',\n",
" 'normalizer',\n",
" 'output_neurons',\n",
" 'pretrainer',\n",
" 'rnn_bidirectional',\n",
" 'rnn_class',\n",
" 'rnn_layers',\n",
" 'rnn_neurons',\n",
" 'rnnlm_scorer',\n",
" 'sample_rate',\n",
" 'scorer',\n",
" 'seq_lin',\n",
" 'temperature',\n",
" 'temperature_lm',\n",
" 'time_pooling_size',\n",
" 'tokenizer',\n",
" 'using_max_attn_shift']"
]
},
"execution_count": 25,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"dir(asr_model.hparams)"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "rUsVgcjgKJKz"
},
"source": [
"Such information are pretty useful as we can directly use some of these hyperparameters in our fine-tuning pipeline to ensure compability with the pretrained model (e.g. use the same BOS or EOS indexes)!"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "BDYhruKqLv0G"
},
"source": [
"### Setting up the data pipeline"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "Uz8KzuQPEdW-"
},
"source": [
"First we must set up the data pipeline for downloaded MiniLibriSpeech data.\n",
"\n",
"If you are not familiar with **SpeechBrain dataIO** you may want to take a look at the [tutorial](https://speechbrain.readthedocs.io/en/latest/tutorials/basics/data-loading-pipeline.html)."
]
},
{
"cell_type": "code",
"execution_count": 26,
"metadata": {
"executionInfo": {
"elapsed": 56,
"status": "ok",
"timestamp": 1706105775758,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "MB9zoQGFcjsd"
},
"outputs": [],
"source": [
"import speechbrain as sb\n",
"import torch"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "axAQJISREGM7"
},
"source": [
"We parse MiniLibriSpeech to a suitable JSON annotation"
]
},
{
"cell_type": "code",
"execution_count": 27,
"metadata": {
"executionInfo": {
"elapsed": 3189,
"status": "ok",
"timestamp": 1706105778894,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "DwcQjRS2cnL5"
},
"outputs": [],
"source": [
"from parse_data import parse_to_json # parse_data is a local library downloaded before (see Installing Dependencies step)\n",
"parse_to_json(\"./LibriSpeech/dev-clean-2\")"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "VIR_XyydEOTS"
},
"source": [
"We instantiate a **DynamicItemDataset** from the JSON annotation"
]
},
{
"cell_type": "code",
"execution_count": 28,
"metadata": {
"executionInfo": {
"elapsed": 246,
"status": "ok",
"timestamp": 1706105778898,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "kdBfsbdUb3kn"
},
"outputs": [],
"source": [
"from speechbrain.dataio.dataset import DynamicItemDataset\n",
"dataset = DynamicItemDataset.from_json(\"data.json\")"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "NEB015VjMDLR"
},
"source": [
"We sort the dataset based on length to speed-up training"
]
},
{
"cell_type": "code",
"execution_count": 29,
"metadata": {
"executionInfo": {
"elapsed": 237,
"status": "ok",
"timestamp": 1706105778899,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "YSHVrP3CgLq2"
},
"outputs": [],
"source": [
"dataset = dataset.filtered_sorted(sort_key=\"length\", select_n=100)\n",
"# we limit the dataset to 100 utterances to keep the trainin short in this Colab example"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "npAUJCOEMhXE"
},
"source": [
"and add a pipeline for reading audio"
]
},
{
"cell_type": "code",
"execution_count": 30,
"metadata": {
"executionInfo": {
"elapsed": 196,
"status": "ok",
"timestamp": 1706105778899,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "Kauu_ke5eglF"
},
"outputs": [],
"source": [
"dataset.add_dynamic_item(sb.dataio.dataio.read_audio, takes=\"file_path\", provides=\"signal\")"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "M1K1xvEHMnmP"
},
"source": [
"and another one to encode the words from annotation.\n",
"\n",
"It is worth noting that we use the Tokenizer object obtained from the pretrained `asr_model` and that we encode the words with `asr_model.tokenizer.encode_as_ids(words)`. We also reuse `asr_model` `eos_index` and `bos_index` accessed via `asr_model.hparams` to ensure that all these parameters correspond to the ones used at pretraining time!"
]
},
{
"cell_type": "code",
"execution_count": 31,
"metadata": {
"executionInfo": {
"elapsed": 176,
"status": "ok",
"timestamp": 1706105778899,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "bf1rDbYBeh-7"
},
"outputs": [],
"source": [
"# 3. Define text pipeline:\n",
"@sb.utils.data_pipeline.takes(\"words\")\n",
"@sb.utils.data_pipeline.provides(\n",
" \"words\", \"tokens_list\", \"tokens_bos\", \"tokens_eos\", \"tokens\")\n",
"def text_pipeline(words):\n",
" yield words\n",
" tokens_list = asr_model.tokenizer.encode_as_ids(words)\n",
" yield tokens_list\n",
" tokens_bos = torch.LongTensor([asr_model.hparams.bos_index] + (tokens_list))\n",
" yield tokens_bos\n",
" tokens_eos = torch.LongTensor(tokens_list + [asr_model.hparams.eos_index]) # we use same eos and bos indexes as in pretrained model\n",
" yield tokens_eos\n",
" tokens = torch.LongTensor(tokens_list)\n",
" yield tokens"
]
},
{
"cell_type": "code",
"execution_count": 32,
"metadata": {
"executionInfo": {
"elapsed": 169,
"status": "ok",
"timestamp": 1706105778901,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "5ZaW1-WEwhDf"
},
"outputs": [],
"source": [
"dataset.add_dynamic_item(text_pipeline)"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "1Ijrx8r8OhuH"
},
"source": [
"We set the dataset object to return the signal tensor as well as the encoded tokens and words."
]
},
{
"cell_type": "code",
"execution_count": 33,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"executionInfo": {
"elapsed": 163,
"status": "ok",
"timestamp": 1706105778901,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "cAulkwZRfzDo",
"outputId": "cc674614-cd45-452b-be72-2c0fefcced62"
},
"outputs": [
{
"data": {
"text/plain": [
"{'id': '777-126732-0081',\n",
" 'signal': tensor([-9.1553e-05, -3.6621e-04, -4.8828e-04, ..., 2.1362e-04,\n",
" 2.4414e-04, 3.3569e-04]),\n",
" 'words': 'COMFORTABLE DEAR',\n",
" 'tokens_list': [875, 157, 598],\n",
" 'tokens_bos': tensor([ 0, 875, 157, 598]),\n",
" 'tokens_eos': tensor([875, 157, 598, 0]),\n",
" 'tokens': tensor([875, 157, 598])}"
]
},
"execution_count": 33,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"dataset.set_output_keys([\"id\", \"signal\", \"words\", \"tokens_list\", \"tokens_bos\", \"tokens_eos\", \"tokens\"])\n",
"dataset[0]"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "9-LZusHdOr61"
},
"source": [
"### Fine-Tuning the ASR model\n",
"\n",
"First, We define our Brain class that will perform the fine-tuning. Here, we just take an example similar to the Brain class of the original [Seq2Seq LibriSpeech recipe](https://github.com/speechbrain/speechbrain/blob/develop/recipes/LibriSpeech/ASR/seq2seq/train.py).\n"
]
},
{
"cell_type": "code",
"execution_count": 34,
"metadata": {
"executionInfo": {
"elapsed": 153,
"status": "ok",
"timestamp": 1706105778903,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "EfpGJ3FIgFRu"
},
"outputs": [],
"source": [
"from speechbrain.lobes.features import Fbank\n",
"import torch\n",
"\n",
"# Define fine-tuning procedure\n",
"class EncDecFineTune(sb.Brain):\n",
"\n",
" def on_stage_start(self, stage, epoch):\n",
" # enable grad for all modules we want to fine-tune\n",
" if stage == sb.Stage.TRAIN:\n",
" for module in [self.modules.enc, self.modules.emb, self.modules.dec, self.modules.seq_lin]:\n",
" for p in module.parameters():\n",
" p.requires_grad = True\n",
"\n",
" def compute_forward(self, batch, stage):\n",
" \"\"\"Forward computations from the waveform batches to the output probabilities.\"\"\"\n",
" batch = batch.to(self.device)\n",
" wavs, wav_lens = batch.signal\n",
" tokens_bos, _ = batch.tokens_bos\n",
" wavs, wav_lens = wavs.to(self.device), wav_lens.to(self.device)\n",
"\n",
" # Forward pass\n",
" feats = self.modules.compute_features(wavs)\n",
" feats = self.modules.normalize(feats, wav_lens)\n",
" #feats.requires_grad = True\n",
" x = self.modules.enc(feats)\n",
"\n",
" e_in = self.modules.emb(tokens_bos) # y_in bos + tokens\n",
" h, _ = self.modules.dec(e_in, x, wav_lens)\n",
"\n",
" # Output layer for seq2seq log-probabilities\n",
" logits = self.modules.seq_lin(h)\n",
" p_seq = self.hparams.log_softmax(logits)\n",
"\n",
" return p_seq, wav_lens\n",
"\n",
" def compute_objectives(self, predictions, batch, stage):\n",
" \"\"\"Computes the loss (CTC+NLL) given predictions and targets.\"\"\"\n",
"\n",
"\n",
" p_seq, wav_lens = predictions\n",
"\n",
" ids = batch.id\n",
" tokens_eos, tokens_eos_lens = batch.tokens_eos\n",
" tokens, tokens_lens = batch.tokens\n",
"\n",
" loss = self.hparams.seq_cost(\n",
" p_seq, tokens_eos, tokens_eos_lens)\n",
"\n",
"\n",
" return loss\n"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "ZJrCTNIBPVS7"
},
"source": [
"Here we define the modules and hyperparameters needed for the Brain class defined before.\n",
"\n",
"We fetch them directly from the pretrained model by accessing its `modules` and `hparams`. These can be found in the `hyperparams.yaml` file in the model [HuggingFace repo](https://huggingface.co/speechbrain/asr-crdnn-rnnlm-librispeech/blob/main/hyperparams.yaml)."
]
},
{
"cell_type": "code",
"execution_count": 35,
"metadata": {
"executionInfo": {
"elapsed": 139,
"status": "ok",
"timestamp": 1706105778903,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "R3B4Dv1Wjfv6"
},
"outputs": [],
"source": [
"modules = {\"enc\": asr_model.mods.encoder.model,\n",
" \"emb\": asr_model.hparams.emb,\n",
" \"dec\": asr_model.hparams.dec,\n",
" \"compute_features\": asr_model.mods.encoder.compute_features, # we use the same features\n",
" \"normalize\": asr_model.mods.encoder.normalize,\n",
" \"seq_lin\": asr_model.hparams.seq_lin,\n",
"\n",
" }\n",
"\n",
"hparams = {\"seq_cost\": lambda x, y, z: speechbrain.nnet.losses.nll_loss(x, y, z, label_smoothing = 0.1),\n",
" \"log_softmax\": speechbrain.nnet.activations.Softmax(apply_log=True)}\n",
"\n",
"brain = EncDecFineTune(modules, hparams=hparams, opt_class=lambda x: torch.optim.SGD(x, 1e-5))\n",
"brain.tokenizer = asr_model.tokenizer"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "kqfkX393Rkbb"
},
"source": [
"The pre-trained model can be finally fine-tuned:"
]
},
{
"cell_type": "code",
"execution_count": 36,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"executionInfo": {
"elapsed": 680130,
"status": "ok",
"timestamp": 1706106458896,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "aHWteDB0jXFp",
"outputId": "941550cf-f8a8-4be4-fce5-e26f0118a063"
},
"outputs": [
{
"name": "stderr",
"output_type": "stream",
"text": [
"100%|██████████| 12/12 [05:44<00:00, 28.69s/it, train_loss=1.31]\n",
"100%|██████████| 12/12 [05:35<00:00, 27.99s/it, train_loss=1.28]\n"
]
}
],
"source": [
"brain.fit(range(2), train_set=dataset,\n",
" train_loader_kwargs={\"batch_size\": 8, \"drop_last\":True, \"shuffle\": False})"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "l7qb4lrtG8G-"
},
"source": [
"## Pretrainer Class\n",
"In speechbrain, another way to perform pre-training is to use the PreTrainer Class (`speechbrain.utils.parameter_transfer.Pretrainer`). It orchestrates parameter transfer in a more structured way, which can aid in writing easy-to-share recipes (and it is also central in the implementation `speechbrain.pretrained` models). To use it, let's first initialize a model:"
]
},
{
"cell_type": "code",
"execution_count": 37,
"metadata": {
"executionInfo": {
"elapsed": 61,
"status": "ok",
"timestamp": 1706106458898,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "DJ9Wvc41K3p8"
},
"outputs": [],
"source": [
"from speechbrain.lobes.models.ECAPA_TDNN import ECAPA_TDNN\n",
"\n",
"model = ECAPA_TDNN(input_size= 80,\n",
" channels= [1024, 1024, 1024, 1024, 3072],\n",
" kernel_sizes= [5, 3, 3, 3, 1],\n",
" dilations= [1, 2, 3, 4, 1],\n",
" attention_channels= 128,\n",
" lin_neurons = 192)"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "TFPMuK0eLRWK"
},
"source": [
"At this level, the model is initialized with random parameters. However, we can use our pretrainer to replace random parameters with the ones stored in the saved checkpoint:"
]
},
{
"cell_type": "code",
"execution_count": 38,
"metadata": {
"executionInfo": {
"elapsed": 989,
"status": "ok",
"timestamp": 1706106459847,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "PsBfJrc5MhHV"
},
"outputs": [],
"source": [
"from speechbrain.utils.parameter_transfer import Pretrainer\n",
"\n",
"# Initialization of the pre-trainer\n",
"pretrain = Pretrainer(loadables={'model': model}, paths={'model': 'speechbrain/spkrec-ecapa-voxceleb/embedding_model.ckpt'})\n",
"\n",
"# We download the pretrained model from HuggingFace in this case\n",
"pretrain.collect_files()\n",
"pretrain.load_collected()"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "IBxnWXe4OYSJ"
},
"source": [
"Now, the model is not anymore randomly initialized, but it contains the pre-trained parameters of `embedding_model.ckpt`. The path of the pre-trained model can be a **local path**, a **web url**, or a **huggingface repository**:"
]
},
{
"cell_type": "code",
"execution_count": 39,
"metadata": {
"executionInfo": {
"elapsed": 2641,
"status": "ok",
"timestamp": 1706106462469,
"user": {
"displayName": "adel moumen",
"userId": "01620107593621714109"
},
"user_tz": -60
},
"id": "4AQW7yD3PRLD"
},
"outputs": [],
"source": [
"# Local Path\n",
"pretrain = Pretrainer(collect_in='model_local', loadables={'model': model}, paths={'model': 'model_checkpoints/model.ckpt'})\n",
"pretrain.collect_files()\n",
"pretrain.load_collected()\n",
"\n",
"# Or web\n",
"pretrain = Pretrainer(collect_in='model_web', loadables={'model': model}, paths={'model': 'https://www.dropbox.com/s/2mdnl784ram5w8o/embedding_model.ckpt?dl=1'})\n",
"pretrain.collect_files()\n",
"pretrain.load_collected()"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "BBlIHzVjRHHA"
},
"source": [
"As you can see, you can use the variable `collect_in` to set where the pre-trained model is stored."
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "OyjEzG-6zIFT"
},
"source": [
"## Acknowledgements\n",
"\n",
"\n",
"* Many thanks to ([ziz19](https://github.com/ziz19)) who helped improving this Tutorial.\n"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "sb_auto_footer",
"tags": [
"sb_auto_footer"
]
},
"source": [
"## Citing SpeechBrain\n",
"\n",
"If you use SpeechBrain in your research or business, please cite it using the following BibTeX entry:\n",
"\n",
"```bibtex\n",
"@misc{speechbrainV1,\n",
" title={Open-Source Conversational AI with {SpeechBrain} 1.0},\n",
" author={Mirco Ravanelli and Titouan Parcollet and Adel Moumen and Sylvain de Langen and Cem Subakan and Peter Plantinga and Yingzhi Wang and Pooneh Mousavi and Luca Della Libera and Artem Ploujnikov and Francesco Paissan and Davide Borra and Salah Zaiem and Zeyu Zhao and Shucong Zhang and Georgios Karakasidis and Sung-Lin Yeh and Pierre Champion and Aku Rouhe and Rudolf Braun and Florian Mai and Juan Zuluaga-Gomez and Seyed Mahed Mousavi and Andreas Nautsch and Xuechen Liu and Sangeet Sagar and Jarod Duret and Salima Mdhaffar and Gaelle Laperriere and Mickael Rouvier and Renato De Mori and Yannick Esteve},\n",
" year={2024},\n",
" eprint={2407.00463},\n",
" archivePrefix={arXiv},\n",
" primaryClass={cs.LG},\n",
" url={https://arxiv.org/abs/2407.00463},\n",
"}\n",
"@misc{speechbrain,\n",
" title={{SpeechBrain}: A General-Purpose Speech Toolkit},\n",
" author={Mirco Ravanelli and Titouan Parcollet and Peter Plantinga and Aku Rouhe and Samuele Cornell and Loren Lugosch and Cem Subakan and Nauman Dawalatabad and Abdelwahab Heba and Jianyuan Zhong and Ju-Chieh Chou and Sung-Lin Yeh and Szu-Wei Fu and Chien-Feng Liao and Elena Rastorgueva and François Grondin and William Aris and Hwidong Na and Yan Gao and Renato De Mori and Yoshua Bengio},\n",
" year={2021},\n",
" eprint={2106.04624},\n",
" archivePrefix={arXiv},\n",
" primaryClass={eess.AS},\n",
" note={arXiv:2106.04624}\n",
"}\n",
"```"
]
}
],
"metadata": {
"accelerator": "GPU",
"colab": {
"provenance": [
{
"file_id": "1LN7R3U3xneDgDRK2gC5MzGkLysCWxuC3",
"timestamp": 1706026019611
},
{
"file_id": "1228U7DsXZ3A_B3tkZoQhixC0WP6O0DZH",
"timestamp": 1615161894564
}
]
},
"kernelspec": {
"display_name": "Python 3 (ipykernel)",
"language": "python",
"name": "python3"
},
"language_info": {
"codemirror_mode": {
"name": "ipython",
"version": 3
},
"file_extension": ".py",
"mimetype": "text/x-python",
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.12.6"
},
"widgets": {
"application/vnd.jupyter.widget-state+json": {
"000de1ccc95c4cd8850d3a3424f4714a": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"00b563eeca124124bc81f8f19a5f0e48": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HBoxModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HBoxModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HBoxView",
"box_style": "",
"children": [
"IPY_MODEL_86b24bfbc04d4bda8cce53a140c17e62",
"IPY_MODEL_4ef78f63daba4f20a768e58c023a8eee",
"IPY_MODEL_daaf30a442cb4fb48db9a082a40c6376"
],
"layout": "IPY_MODEL_6b302652bec7427680692afe5c3630f9"
}
},
"01a0f8b6ae4e4fbcaf1e96dd3adce92a": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"0420cacd6a7349e8b7ccaef1ddc985b2": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "DescriptionStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "DescriptionStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"description_width": ""
}
},
"0631b7878fd14f38b0f8270c1fafe391": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HBoxModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HBoxModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HBoxView",
"box_style": "",
"children": [
"IPY_MODEL_f3bc35d9420f44239f719e2f4b37d379",
"IPY_MODEL_df2df25b22aa434ebaa769dce4162ca8",
"IPY_MODEL_7def4f14f4414bd3a0b25bb628863123"
],
"layout": "IPY_MODEL_dcfa2ee4056a47a38a4bb14deafe7366"
}
},
"0657d483243b46748b6dd499a188b588": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "DescriptionStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "DescriptionStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"description_width": ""
}
},
"0adda9c3d3a14ceaa3d247b59c962554": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "FloatProgressModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "FloatProgressModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "ProgressView",
"bar_style": "success",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_402e80d5952d4da991f798672ff53d46",
"max": 1409,
"min": 0,
"orientation": "horizontal",
"style": "IPY_MODEL_2232c1b90a0a40d7b470a492dd470197",
"value": 1409
}
},
"0c1d9a4d91eb4f0397bc17c1abeafcd6": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HTMLModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HTMLModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HTMLView",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_9b1b16de38574725bcbf9527f77b8820",
"placeholder": "",
"style": "IPY_MODEL_c81777f5d3814ced8096613714f3d054",
"value": "decoder.ckpt: 100%"
}
},
"0d3e8b469920445f88475b4496a5d66a": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "FloatProgressModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "FloatProgressModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "ProgressView",
"bar_style": "success",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_000de1ccc95c4cd8850d3a3424f4714a",
"max": 1920,
"min": 0,
"orientation": "horizontal",
"style": "IPY_MODEL_5d221ae2b9ac4e36a7cfe2cce3c536dc",
"value": 1920
}
},
"0d4c194f09524aac95e602a14d9a485d": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"0d555777e2d2405698247f6fb163454d": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HTMLModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HTMLModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HTMLView",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_eb2aa07593d44cbcae05ace5ace724a8",
"placeholder": "",
"style": "IPY_MODEL_a2d5bacd3dfc4279b7434002341d000b",
"value": "mean_var_norm_emb.ckpt: 100%"
}
},
"11890cbf63b24f13b0f3e75b7fc68d01": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"16c602c5ca4b42d5a22e97249dbc8316": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HTMLModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HTMLModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HTMLView",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_a9ede27dcd6c4c17aad2e03976788ac8",
"placeholder": "",
"style": "IPY_MODEL_1791bf4e7a7f4f7aa03bb9c420f2c3af",
"value": " 113M/113M [00:00<00:00, 168MB/s]"
}
},
"16f0ca4e8c1944a1a1e90b5484f9a270": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"1791bf4e7a7f4f7aa03bb9c420f2c3af": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "DescriptionStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "DescriptionStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"description_width": ""
}
},
"1861687899e8426cb9bc7c74d0a51aea": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "DescriptionStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "DescriptionStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"description_width": ""
}
},
"1bcc055f1b474119bb9b734939340767": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "ProgressStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "ProgressStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"bar_color": null,
"description_width": ""
}
},
"1d4f4e45172e432a9a6a9e2545b87e6b": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "DescriptionStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "DescriptionStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"description_width": ""
}
},
"1ea356cbbabf483b94fac984fa0d3690": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "FloatProgressModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "FloatProgressModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "ProgressView",
"bar_style": "success",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_303541f7df7044b1b43c6bd38d8058f1",
"max": 253217,
"min": 0,
"orientation": "horizontal",
"style": "IPY_MODEL_1ff81f3732074056a9f1834501219e55",
"value": 253217
}
},
"1ff81f3732074056a9f1834501219e55": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "ProgressStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "ProgressStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"bar_color": null,
"description_width": ""
}
},
"2232c1b90a0a40d7b470a492dd470197": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "ProgressStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "ProgressStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"bar_color": null,
"description_width": ""
}
},
"241bb75e8c0141ec8c00ef562d0feb5f": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"24ee8a32861b4a3daa79a35583175dc7": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "DescriptionStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "DescriptionStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"description_width": ""
}
},
"2961959a379f4934b2f47f3ec99736cd": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"2afeeaed1b344835bc0cd7a3f16add8e": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"2e8935dded774cb9bcd87167992c5558": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "ProgressStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "ProgressStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"bar_color": null,
"description_width": ""
}
},
"2fda19c612c5486dbf75a5de2d6ebcda": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"303541f7df7044b1b43c6bd38d8058f1": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"304a1d7486b94d8c83371c54cfda2ca4": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"3301f47181664600aac6a0483dfa69a2": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HTMLModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HTMLModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HTMLView",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_01a0f8b6ae4e4fbcaf1e96dd3adce92a",
"placeholder": "",
"style": "IPY_MODEL_9707ff2d35094cfd97c39d166579cdba",
"value": " 253k/253k [00:00<00:00, 4.97MB/s]"
}
},
"3461887798324f60993c526e21a197ff": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"38550314ccb744c78b779de82a9f6d8e": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"3940e8873ae3498393094ea7c361a7fc": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"3bd1dfae506d4299af956d497d96d9ad": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "DescriptionStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "DescriptionStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"description_width": ""
}
},
"3fec66291aed46e9aaec1e60748760d6": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"402e80d5952d4da991f798672ff53d46": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"4873f222358a46c7b50d741a1932c5a6": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HBoxModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HBoxModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HBoxView",
"box_style": "",
"children": [
"IPY_MODEL_b5d8d5c9c94b4329a7cf143448476408",
"IPY_MODEL_0adda9c3d3a14ceaa3d247b59c962554",
"IPY_MODEL_a1e78669452a47899a85a7fae3a15661"
],
"layout": "IPY_MODEL_8073c957b55e4b1c870b8e7c50d3765a"
}
},
"4b7f1dcce7c14f758c8b33e196214a88": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "FloatProgressModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "FloatProgressModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "ProgressView",
"bar_style": "success",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_5c5bc290e7664009a63b8bc45d676aa7",
"max": 479555971,
"min": 0,
"orientation": "horizontal",
"style": "IPY_MODEL_adba26074a384a34ac2866813537c0d3",
"value": 479555971
}
},
"4d695e2724324b5fa4af39345b38226c": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HTMLModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HTMLModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HTMLView",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_f81b74f0764a440392633978639dc9a8",
"placeholder": "",
"style": "IPY_MODEL_0420cacd6a7349e8b7ccaef1ddc985b2",
"value": " 480M/480M [00:03<00:00, 137MB/s]"
}
},
"4ef78f63daba4f20a768e58c023a8eee": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "FloatProgressModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "FloatProgressModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "ProgressView",
"bar_style": "success",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_6d597a48192e436f89b71fd1b18a37fb",
"max": 17267,
"min": 0,
"orientation": "horizontal",
"style": "IPY_MODEL_bd7023fc26be4623ab2c0e98b242ea1a",
"value": 17267
}
},
"518849236e44483f803078be7ad8dc93": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HBoxModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HBoxModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HBoxView",
"box_style": "",
"children": [
"IPY_MODEL_f2660154764f4be4ba404d1e6e994271",
"IPY_MODEL_0d3e8b469920445f88475b4496a5d66a",
"IPY_MODEL_576907c14b614dbc8b7d0253909f9e99"
],
"layout": "IPY_MODEL_ece9d78d617444f2a31fc912237d25cb"
}
},
"5217db8767a042f098a971ee4c02c731": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "DescriptionStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "DescriptionStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"description_width": ""
}
},
"5338ff1061d14c89ad7c8bd7317a4642": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HBoxModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HBoxModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HBoxView",
"box_style": "",
"children": [
"IPY_MODEL_a1b9d608708d4e9d962dbfa65f2b8951",
"IPY_MODEL_6eaaa4ebfe4440ebb750c853a7545e17",
"IPY_MODEL_84864afa1f0d447ca0d5a38f972ab1f3"
],
"layout": "IPY_MODEL_6a38bd3599754589b4f9c17f39adeb92"
}
},
"576907c14b614dbc8b7d0253909f9e99": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HTMLModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HTMLModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HTMLView",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_5ba74f54df8f4b11a58aee4c66b554f7",
"placeholder": "",
"style": "IPY_MODEL_684b9471808648b7bda92f1dd4afb25f",
"value": " 1.92k/1.92k [00:00<00:00, 106kB/s]"
}
},
"596d1f66a8cd480ab32af9f3f3025edc": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "DescriptionStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "DescriptionStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"description_width": ""
}
},
"5a4bb7e698db43ab98cf5e3cad123eff": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HTMLModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HTMLModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HTMLView",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_16f0ca4e8c1944a1a1e90b5484f9a270",
"placeholder": "",
"style": "IPY_MODEL_8c5f52ed4b7042df8bb636e73c702d64",
"value": " 1.51k/1.51k [00:00<00:00, 57.7kB/s]"
}
},
"5ba74f54df8f4b11a58aee4c66b554f7": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"5bb62e9fe8f14b898666af7527389908": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"5bcd65e2cc574d428cf8fa49207b1d0f": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "FloatProgressModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "FloatProgressModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "ProgressView",
"bar_style": "success",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_3461887798324f60993c526e21a197ff",
"max": 17202,
"min": 0,
"orientation": "horizontal",
"style": "IPY_MODEL_1bcc055f1b474119bb9b734939340767",
"value": 17202
}
},
"5c5bc290e7664009a63b8bc45d676aa7": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"5d221ae2b9ac4e36a7cfe2cce3c536dc": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "ProgressStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "ProgressStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"bar_color": null,
"description_width": ""
}
},
"5dcb9b7c948c42a6afb63bd89664744f": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "ProgressStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "ProgressStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"bar_color": null,
"description_width": ""
}
},
"5e58c000011c48879130e6374bbab799": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HTMLModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HTMLModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HTMLView",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_76fffbd6bc9542359181b3333077b888",
"placeholder": "",
"style": "IPY_MODEL_1861687899e8426cb9bc7c74d0a51aea",
"value": " 4.83k/4.83k [00:00<00:00, 325kB/s]"
}
},
"611c74c530d44002b43a09e86fdd133a": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"634871e7ef574c48a22fe20bd29c98fb": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HBoxModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HBoxModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HBoxView",
"box_style": "",
"children": [
"IPY_MODEL_a2c4a9390bd6495aae3a79a7174f5832",
"IPY_MODEL_de326e62dcee451ebafdef0a888f9974",
"IPY_MODEL_fe6ee540077e4fd086ae8975feb97deb"
],
"layout": "IPY_MODEL_890276931b55409cacaccbea256fe745"
}
},
"684b9471808648b7bda92f1dd4afb25f": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "DescriptionStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "DescriptionStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"description_width": ""
}
},
"6a38bd3599754589b4f9c17f39adeb92": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"6b302652bec7427680692afe5c3630f9": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"6b3edbd6a47b4b3982ab30870d853199": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"6d597a48192e436f89b71fd1b18a37fb": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"6e88d9cddfae4c0585a030628f415163": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "FloatProgressModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "FloatProgressModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "ProgressView",
"bar_style": "success",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_7a59681cc6884eeb90cad0ad810eb340",
"max": 1515,
"min": 0,
"orientation": "horizontal",
"style": "IPY_MODEL_5dcb9b7c948c42a6afb63bd89664744f",
"value": 1515
}
},
"6eaaa4ebfe4440ebb750c853a7545e17": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "FloatProgressModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "FloatProgressModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "ProgressView",
"bar_style": "success",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_f0673eaf978145e780399c5d003abb33",
"max": 5534328,
"min": 0,
"orientation": "horizontal",
"style": "IPY_MODEL_a7436702e317468ba76a9c7ab1d7b7bd",
"value": 5534328
}
},
"701f1496c0d145b8b376174ed9501cab": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "DescriptionStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "DescriptionStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"description_width": ""
}
},
"73417ed270d7450984a48f3c7260eef7": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HBoxModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HBoxModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HBoxView",
"box_style": "",
"children": [
"IPY_MODEL_85a4d1969185444aa63499a3e59faa2c",
"IPY_MODEL_ee1bf41d42a54f9a92d76f5394626e97",
"IPY_MODEL_5e58c000011c48879130e6374bbab799"
],
"layout": "IPY_MODEL_7ea8ba3f9016452bb6ec20d3502675df"
}
},
"747b0366a0284c4188d441e934021fa8": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "ProgressStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "ProgressStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"bar_color": null,
"description_width": ""
}
},
"75d1e7af67264ffca59cc387db02d6d7": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HBoxModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HBoxModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HBoxView",
"box_style": "",
"children": [
"IPY_MODEL_0d555777e2d2405698247f6fb163454d",
"IPY_MODEL_a89727caed4642e7af12415c8ca66641",
"IPY_MODEL_8718c8b37bea4e53ac6457276ce63045"
],
"layout": "IPY_MODEL_dcfbc459a1d6415bb9cb71cf6d65a51f"
}
},
"76a0e79fab2644908c86b7784d67504e": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"76fffbd6bc9542359181b3333077b888": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"78cfac8bcaea470ebfba4104154cec3d": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"7a0a2f4b5b1c41c2bd27f1406568ff34": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "DescriptionStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "DescriptionStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"description_width": ""
}
},
"7a59681cc6884eeb90cad0ad810eb340": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"7b0782edb2394087910b772c90b03be9": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"7cfb724f62f14f889a3d3a69a9e7acd8": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"7def4f14f4414bd3a0b25bb628863123": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HTMLModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HTMLModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HTMLView",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_886dbc6801664287b38590260ba33286",
"placeholder": "",
"style": "IPY_MODEL_5217db8767a042f098a971ee4c02c731",
"value": " 129k/129k [00:00<00:00, 3.24MB/s]"
}
},
"7ea8ba3f9016452bb6ec20d3502675df": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"8073c957b55e4b1c870b8e7c50d3765a": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"84864afa1f0d447ca0d5a38f972ab1f3": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HTMLModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HTMLModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HTMLView",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_38550314ccb744c78b779de82a9f6d8e",
"placeholder": "",
"style": "IPY_MODEL_596d1f66a8cd480ab32af9f3f3025edc",
"value": " 5.53M/5.53M [00:00<00:00, 143MB/s]"
}
},
"84bada4f0df245469620edab3ad40c38": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"85a4d1969185444aa63499a3e59faa2c": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HTMLModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HTMLModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HTMLView",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_76a0e79fab2644908c86b7784d67504e",
"placeholder": "",
"style": "IPY_MODEL_ab133c95b3da4bdf86777ade47d60698",
"value": "hyperparams_develop.yaml: 100%"
}
},
"86b24bfbc04d4bda8cce53a140c17e62": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HTMLModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HTMLModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HTMLView",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_78cfac8bcaea470ebfba4104154cec3d",
"placeholder": "",
"style": "IPY_MODEL_d9b66e1b93fb4664beeadcf100a43232",
"value": "encoder.ckpt: 100%"
}
},
"8718c8b37bea4e53ac6457276ce63045": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HTMLModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HTMLModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HTMLView",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_611c74c530d44002b43a09e86fdd133a",
"placeholder": "",
"style": "IPY_MODEL_c22924e5299d4ea79ad2dc6257ce8d6b",
"value": " 1.92k/1.92k [00:00<00:00, 131kB/s]"
}
},
"87d1d3bebd594b798db2cd726046fbb1": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"886dbc6801664287b38590260ba33286": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"890276931b55409cacaccbea256fe745": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"891f3d15f25a4cc2a64f4e7013d48e54": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"89f354d3bb7d40a9ba8b106071802006": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"8c5f52ed4b7042df8bb636e73c702d64": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "DescriptionStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "DescriptionStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"description_width": ""
}
},
"8c9d3cdb6d9248129db49203fb4df0ec": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "DescriptionStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "DescriptionStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"description_width": ""
}
},
"8d0a5753b71243c59f4741043f98b857": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "ProgressStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "ProgressStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"bar_color": null,
"description_width": ""
}
},
"8e66c81421af4032a4048dda5f7db960": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "DescriptionStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "DescriptionStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"description_width": ""
}
},
"934446687ef449149f71c9c64923ed4d": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "DescriptionStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "DescriptionStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"description_width": ""
}
},
"94ac439a7b2344acb89dd968f4832d24": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "FloatProgressModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "FloatProgressModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "ProgressView",
"bar_style": "success",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_2961959a379f4934b2f47f3ec99736cd",
"max": 113108458,
"min": 0,
"orientation": "horizontal",
"style": "IPY_MODEL_d439ae84c3cd41f0b89eaa7c32ba310e",
"value": 113108458
}
},
"96b01ae3bf274b3e84cda3f94dd564fb": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"9707ff2d35094cfd97c39d166579cdba": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "DescriptionStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "DescriptionStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"description_width": ""
}
},
"9713800931064fd3809f1fd0a2bc2d03": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "DescriptionStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "DescriptionStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"description_width": ""
}
},
"975f5572379d4dd2b4776d5469ca1bb7": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HTMLModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HTMLModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HTMLView",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_87d1d3bebd594b798db2cd726046fbb1",
"placeholder": "",
"style": "IPY_MODEL_9c9985770a644c60a40d8a5479a19c48",
"value": "embedding_model.ckpt: 100%"
}
},
"98ea97d41a6c4565a238d184ac9bd09a": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "ProgressStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "ProgressStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"bar_color": null,
"description_width": ""
}
},
"9a755c6dcb464a4c91ba4443ea9d30d9": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HBoxModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HBoxModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HBoxView",
"box_style": "",
"children": [
"IPY_MODEL_0c1d9a4d91eb4f0397bc17c1abeafcd6",
"IPY_MODEL_5bcd65e2cc574d428cf8fa49207b1d0f",
"IPY_MODEL_e600eb9e6fb74c35b3015ac6d56b5b90"
],
"layout": "IPY_MODEL_89f354d3bb7d40a9ba8b106071802006"
}
},
"9b1b16de38574725bcbf9527f77b8820": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"9c9985770a644c60a40d8a5479a19c48": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "DescriptionStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "DescriptionStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"description_width": ""
}
},
"9e69e88263a24037aa45fb9f837c2c40": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HBoxModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HBoxModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HBoxView",
"box_style": "",
"children": [
"IPY_MODEL_cb5045ef6ee544cf9e7f4d7cf772c14f",
"IPY_MODEL_1ea356cbbabf483b94fac984fa0d3690",
"IPY_MODEL_3301f47181664600aac6a0483dfa69a2"
],
"layout": "IPY_MODEL_a3f6fdd0090c4c35b1f44d01be6d8e4f"
}
},
"a0317c2f06cf410783a893b8187e00c3": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HTMLModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HTMLModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HTMLView",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_5bb62e9fe8f14b898666af7527389908",
"placeholder": "",
"style": "IPY_MODEL_701f1496c0d145b8b376174ed9501cab",
"value": " 83.3M/83.3M [00:00<00:00, 170MB/s]"
}
},
"a1b9d608708d4e9d962dbfa65f2b8951": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HTMLModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HTMLModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HTMLView",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_ae6a556144e54692b1be363027c1e867",
"placeholder": "",
"style": "IPY_MODEL_8e66c81421af4032a4048dda5f7db960",
"value": "classifier.ckpt: 100%"
}
},
"a1e78669452a47899a85a7fae3a15661": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HTMLModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HTMLModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HTMLView",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_3940e8873ae3498393094ea7c361a7fc",
"placeholder": "",
"style": "IPY_MODEL_e2cf26fb7f29467daef310993935888f",
"value": " 1.41k/1.41k [00:00<00:00, 22.6kB/s]"
}
},
"a2c4a9390bd6495aae3a79a7174f5832": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HTMLModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HTMLModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HTMLView",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_7b0782edb2394087910b772c90b03be9",
"placeholder": "",
"style": "IPY_MODEL_0657d483243b46748b6dd499a188b588",
"value": "lm.ckpt: 100%"
}
},
"a2d5bacd3dfc4279b7434002341d000b": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "DescriptionStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "DescriptionStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"description_width": ""
}
},
"a3f6fdd0090c4c35b1f44d01be6d8e4f": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"a6d2f27d5d4c493083ead216c8137c89": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "DescriptionStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "DescriptionStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"description_width": ""
}
},
"a7436702e317468ba76a9c7ab1d7b7bd": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "ProgressStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "ProgressStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"bar_color": null,
"description_width": ""
}
},
"a89727caed4642e7af12415c8ca66641": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "FloatProgressModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "FloatProgressModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "ProgressView",
"bar_style": "success",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_e94b2fcd8c8d495ea7ebd6beeab5dad0",
"max": 1921,
"min": 0,
"orientation": "horizontal",
"style": "IPY_MODEL_c62d9509f5d9449590c067db7631d10a",
"value": 1921
}
},
"a9ede27dcd6c4c17aad2e03976788ac8": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"ab133c95b3da4bdf86777ade47d60698": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "DescriptionStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "DescriptionStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"description_width": ""
}
},
"adba26074a384a34ac2866813537c0d3": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "ProgressStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "ProgressStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"bar_color": null,
"description_width": ""
}
},
"ae6a556144e54692b1be363027c1e867": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"b28ec6dd2556486693cb7657158b4f35": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"b53ce8b214574bde84833798ab1e0a0e": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HBoxModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HBoxModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HBoxView",
"box_style": "",
"children": [
"IPY_MODEL_975f5572379d4dd2b4776d5469ca1bb7",
"IPY_MODEL_edb3172c98ff4ad8a27f35d1a7835906",
"IPY_MODEL_a0317c2f06cf410783a893b8187e00c3"
],
"layout": "IPY_MODEL_2fda19c612c5486dbf75a5de2d6ebcda"
}
},
"b5d8d5c9c94b4329a7cf143448476408": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HTMLModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HTMLModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HTMLView",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_84bada4f0df245469620edab3ad40c38",
"placeholder": "",
"style": "IPY_MODEL_3bd1dfae506d4299af956d497d96d9ad",
"value": "normalizer.ckpt: 100%"
}
},
"b7ff251217dc4a31abd29db0d8ddb8ee": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HTMLModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HTMLModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HTMLView",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_c65d659414184d6bbf896b581177e1a4",
"placeholder": "",
"style": "IPY_MODEL_f92e99fc7682436a85d11ec2f115e206",
"value": "hyperparams.yaml: 100%"
}
},
"baa6984bd26244ce849d203aa0d2dc30": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"bac9acbddead48e1b90aded2f686c5d7": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HTMLModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HTMLModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HTMLView",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_b28ec6dd2556486693cb7657158b4f35",
"placeholder": "",
"style": "IPY_MODEL_a6d2f27d5d4c493083ead216c8137c89",
"value": "asr.ckpt: 100%"
}
},
"bd7023fc26be4623ab2c0e98b242ea1a": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "ProgressStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "ProgressStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"bar_color": null,
"description_width": ""
}
},
"c22924e5299d4ea79ad2dc6257ce8d6b": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "DescriptionStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "DescriptionStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"description_width": ""
}
},
"c62d9509f5d9449590c067db7631d10a": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "ProgressStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "ProgressStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"bar_color": null,
"description_width": ""
}
},
"c65d659414184d6bbf896b581177e1a4": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"c81777f5d3814ced8096613714f3d054": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "DescriptionStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "DescriptionStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"description_width": ""
}
},
"cb5045ef6ee544cf9e7f4d7cf772c14f": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HTMLModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HTMLModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HTMLView",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_3fec66291aed46e9aaec1e60748760d6",
"placeholder": "",
"style": "IPY_MODEL_934446687ef449149f71c9c64923ed4d",
"value": "tokenizer.ckpt: 100%"
}
},
"ccd1e7c8a24f4a5e90875d85ca2cf6a3": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "DescriptionStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "DescriptionStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"description_width": ""
}
},
"d3278bfc8503432b8d16c9ad47963ee5": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HBoxModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HBoxModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HBoxView",
"box_style": "",
"children": [
"IPY_MODEL_bac9acbddead48e1b90aded2f686c5d7",
"IPY_MODEL_4b7f1dcce7c14f758c8b33e196214a88",
"IPY_MODEL_4d695e2724324b5fa4af39345b38226c"
],
"layout": "IPY_MODEL_baa6984bd26244ce849d203aa0d2dc30"
}
},
"d37c1933e8a24a11ae9a2b3180e53309": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"d439ae84c3cd41f0b89eaa7c32ba310e": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "ProgressStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "ProgressStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"bar_color": null,
"description_width": ""
}
},
"d7765befe0af40e9bb810f5896f4b52a": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"d9b66e1b93fb4664beeadcf100a43232": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "DescriptionStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "DescriptionStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"description_width": ""
}
},
"daaf30a442cb4fb48db9a082a40c6376": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HTMLModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HTMLModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HTMLView",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_2afeeaed1b344835bc0cd7a3f16add8e",
"placeholder": "",
"style": "IPY_MODEL_ccd1e7c8a24f4a5e90875d85ca2cf6a3",
"value": " 17.3k/17.3k [00:00<00:00, 883kB/s]"
}
},
"dcfa2ee4056a47a38a4bb14deafe7366": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"dcfbc459a1d6415bb9cb71cf6d65a51f": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"de326e62dcee451ebafdef0a888f9974": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "FloatProgressModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "FloatProgressModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "ProgressView",
"bar_style": "success",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_d7765befe0af40e9bb810f5896f4b52a",
"max": 212420087,
"min": 0,
"orientation": "horizontal",
"style": "IPY_MODEL_8d0a5753b71243c59f4741043f98b857",
"value": 212420087
}
},
"df2df25b22aa434ebaa769dce4162ca8": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "FloatProgressModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "FloatProgressModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "ProgressView",
"bar_style": "success",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_96b01ae3bf274b3e84cda3f94dd564fb",
"max": 128619,
"min": 0,
"orientation": "horizontal",
"style": "IPY_MODEL_747b0366a0284c4188d441e934021fa8",
"value": 128619
}
},
"e2cf26fb7f29467daef310993935888f": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "DescriptionStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "DescriptionStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"description_width": ""
}
},
"e600eb9e6fb74c35b3015ac6d56b5b90": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HTMLModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HTMLModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HTMLView",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_0d4c194f09524aac95e602a14d9a485d",
"placeholder": "",
"style": "IPY_MODEL_1d4f4e45172e432a9a6a9e2545b87e6b",
"value": " 17.2k/17.2k [00:00<00:00, 1.10MB/s]"
}
},
"e625e51535634cb88f89f93c1b95a5b8": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HBoxModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HBoxModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HBoxView",
"box_style": "",
"children": [
"IPY_MODEL_b7ff251217dc4a31abd29db0d8ddb8ee",
"IPY_MODEL_6e88d9cddfae4c0585a030628f415163",
"IPY_MODEL_5a4bb7e698db43ab98cf5e3cad123eff"
],
"layout": "IPY_MODEL_d37c1933e8a24a11ae9a2b3180e53309"
}
},
"e94b2fcd8c8d495ea7ebd6beeab5dad0": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"ea33a83bcbbc4ba5a983712f1d197e17": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"eb2aa07593d44cbcae05ace5ace724a8": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"ece9d78d617444f2a31fc912237d25cb": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"edb3172c98ff4ad8a27f35d1a7835906": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "FloatProgressModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "FloatProgressModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "ProgressView",
"bar_style": "success",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_241bb75e8c0141ec8c00ef562d0feb5f",
"max": 83316686,
"min": 0,
"orientation": "horizontal",
"style": "IPY_MODEL_98ea97d41a6c4565a238d184ac9bd09a",
"value": 83316686
}
},
"ee1bf41d42a54f9a92d76f5394626e97": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "FloatProgressModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "FloatProgressModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "ProgressView",
"bar_style": "success",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_7cfb724f62f14f889a3d3a69a9e7acd8",
"max": 4832,
"min": 0,
"orientation": "horizontal",
"style": "IPY_MODEL_2e8935dded774cb9bcd87167992c5558",
"value": 4832
}
},
"f0673eaf978145e780399c5d003abb33": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"f2660154764f4be4ba404d1e6e994271": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HTMLModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HTMLModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HTMLView",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_891f3d15f25a4cc2a64f4e7013d48e54",
"placeholder": "",
"style": "IPY_MODEL_9713800931064fd3809f1fd0a2bc2d03",
"value": "hyperparams.yaml: 100%"
}
},
"f3bc35d9420f44239f719e2f4b37d379": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HTMLModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HTMLModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HTMLView",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_11890cbf63b24f13b0f3e75b7fc68d01",
"placeholder": "",
"style": "IPY_MODEL_24ee8a32861b4a3daa79a35583175dc7",
"value": "label_encoder.txt: 100%"
}
},
"f52c23a438e2415cb4632ae276299cc4": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HTMLModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HTMLModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HTMLView",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_6b3edbd6a47b4b3982ab30870d853199",
"placeholder": "",
"style": "IPY_MODEL_8c9d3cdb6d9248129db49203fb4df0ec",
"value": "masknet.ckpt: 100%"
}
},
"f6739e26b4de4cb8b3d9e3f62876325f": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HBoxModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HBoxModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HBoxView",
"box_style": "",
"children": [
"IPY_MODEL_f52c23a438e2415cb4632ae276299cc4",
"IPY_MODEL_94ac439a7b2344acb89dd968f4832d24",
"IPY_MODEL_16c602c5ca4b42d5a22e97249dbc8316"
],
"layout": "IPY_MODEL_ea33a83bcbbc4ba5a983712f1d197e17"
}
},
"f81b74f0764a440392633978639dc9a8": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"f92e99fc7682436a85d11ec2f115e206": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "DescriptionStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "DescriptionStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"description_width": ""
}
},
"fe6ee540077e4fd086ae8975feb97deb": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HTMLModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HTMLModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HTMLView",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_304a1d7486b94d8c83371c54cfda2ca4",
"placeholder": "",
"style": "IPY_MODEL_7a0a2f4b5b1c41c2bd27f1406568ff34",
"value": " 212M/212M [00:03<00:00, 101MB/s]"
}
}
}
}
},
"nbformat": 4,
"nbformat_minor": 4
}