机器学习应用课题-科比投篮预测

数据集及源码获取地址：
链接：https://pan.baidu.com/s/1Q64QqMUBB5PkvOPgBGI3bQ
提取码：tz2k

1.课题任务：

课后作业（40 分）

目的：应用机器学习算法到生活中。

学生在本学期末需提交一个文档（30 分）和视频（10 分）

文档要求：提交一个 pdf 格式的报告和 .ipynb 及相关资源打包 zip （30 分）

学生使用 3-5 种机器学习算法（不限于本课程涉及的算法）对某个数据集进行分析，该数据集必须是最近两年内产生的。文档要体现比较各个算法的差异性以及调优过程。

报告不少于 1000 字（5-8 页 A4），可以是文字描述+代码截图+图片，文字包含：数据的来源，描述该数据集各个属性，打算预测什么，如何预测，调优，以及结论。一个数据集可同时应用分类和回归。

学生如果找不到合适的数据集，可使用以下数据。
https://www.kaggle.com/sudalairajkumar/novel-corona-virus-2019-dataset

学生还需提交一个 5 分钟左右的视频，用于描述本文档的工作，可以是屏幕录像+讲解的方式。

2.为什么想做这个课题

世界变换莫测，本来一个传奇球星可以在退役后享受生活，但却造化弄人，突如其来的意外事故，带走了无数篮球爱好者心中的偶像与信仰。科比布莱恩特，2020年1月26日他因直升机事故意外身亡，享年41岁。

很多人都想多看一次科比经典的后仰跳投，科比的扣篮，科比的三分等等，但科比已经离开了。。。但是人工智能的发展，可以让我们预测科比能否再投一次，并且投进的概率是多少，所以我想做这样一个课题，科比投篮预测，作为科比的粉丝，只能以此方式悼念他了。Mamba never out!

扫描二维码关注公众号，回复： 11318773 查看本文章

3.数据集简介

数据来源：

数据来源于kaggle，该数据集收集了科比近20年职业生涯中所尝试的每个投篮命中的位置和情况，其中包含了30697次投篮出手的数据，包含了25个特征属性，由于是篮球领域的数据,这里我做一个简短的说明。

数据官方说明和介绍及下载：https://www.kaggle.com/c/kobe-bryant-shot-selection/data

在kaggle上该数据集的准确率最高也只有60%多，与我做的大致相同

数据特征属性有：

action_type 进攻方式（更具体）
combined_shot_type 进攻方式
game_event_id 这个不清楚
game_id 比赛ID
lat 投篮点
loc_x 投篮点
loc_y 投篮点
lon 投篮点
minutes_remaining 单节剩余时间（分钟）
period 表示第几节
playoffs 是否是季后赛
season 赛季
seconds_remaining 剩余时间（秒）
shot_distance 投篮距离
shot_type 两分球或三分球
shot_zone_area 投篮区域
shot_zone_basic 投篮区域（更具体）
shot_zone_range 投篮范围
team_id 球队ID
team_name 球队名称
game_date 比赛日期
matchup 比赛双方
opponent 对手
shot_id 投篮ID

标签：

shot_made_flag 是否进球

这其中也包含了一些不是那么重要的属性和无关的属性，这些我将在数据预处理中进行剔除

4.数据预处理

载入数据

# 导入所需模块
import numpy as np
import pandas as pd
import matplotlib.pyplot as plt

#读入数据
data = pd.read_csv("data.csv")
#显示大小
print("数据集大小:",data.shape)
# 数据集详细信息
print(data.info())

数据集大小: (30697, 25)
<class 'pandas.core.frame.DataFrame'>
RangeIndex: 30697 entries, 0 to 30696
Data columns (total 25 columns):
 #   Column              Non-Null Count  Dtype  
---  ------              --------------  -----  
 0   action_type         30697 non-null  object 
 1   combined_shot_type  30697 non-null  object 
 2   game_event_id       30697 non-null  int64  
 3   game_id             30697 non-null  int64  
 4   lat                 30697 non-null  float64
 5   loc_x               30697 non-null  int64  
 6   loc_y               30697 non-null  int64  
 7   lon                 30697 non-null  float64
 8   minutes_remaining   30697 non-null  int64  
 9   period              30697 non-null  int64  
 10  playoffs            30697 non-null  int64  
 11  season              30697 non-null  object 
 12  seconds_remaining   30697 non-null  int64  
 13  shot_distance       30697 non-null  int64  
 14  shot_made_flag      25697 non-null  float64
 15  shot_type           30697 non-null  object 
 16  shot_zone_area      30697 non-null  object 
 17  shot_zone_basic     30697 non-null  object 
 18  shot_zone_range     30697 non-null  object 
 19  team_id             30697 non-null  int64  
 20  team_name           30697 non-null  object 
 21  game_date           30697 non-null  object 
 22  matchup             30697 non-null  object 
 23  opponent            30697 non-null  object 
 24  shot_id             30697 non-null  int64  
dtypes: float64(3), int64(11), object(11)
memory usage: 5.9+ MB
None

#显示头前5行数据
data.head()

	action_type	combined_shot_type	game_event_id	game_id	lat	loc_x	loc_y	lon	minutes_remaining	period	...	shot_type	shot_zone_area	shot_zone_basic	shot_zone_range	team_id	team_name	game_date	matchup	opponent	shot_id
0	Jump Shot	Jump Shot	10	20000012	33.9723	167	72	-118.1028	10	1	...	2PT Field Goal	Right Side(R)	Mid-Range	16-24 ft.	1610612747	Los Angeles Lakers	2000/10/31	LAL @ POR	POR	1
1	Jump Shot	Jump Shot	12	20000012	34.0443	-157	0	-118.4268	10	1	...	2PT Field Goal	Left Side(L)	Mid-Range	8-16 ft.	1610612747	Los Angeles Lakers	2000/10/31	LAL @ POR	POR	2
2	Jump Shot	Jump Shot	35	20000012	33.9093	-101	135	-118.3708	7	1	...	2PT Field Goal	Left Side Center(LC)	Mid-Range	16-24 ft.	1610612747	Los Angeles Lakers	2000/10/31	LAL @ POR	POR	3
3	Jump Shot	Jump Shot	43	20000012	33.8693	138	175	-118.1318	6	1	...	2PT Field Goal	Right Side Center(RC)	Mid-Range	16-24 ft.	1610612747	Los Angeles Lakers	2000/10/31	LAL @ POR	POR	4
4	Driving Dunk Shot	Dunk	155	20000012	34.0443	0	0	-118.2698	6	2	...	2PT Field Goal	Center(C)	Restricted Area	Less Than 8 ft.	1610612747	Los Angeles Lakers	2000/10/31	LAL @ POR	POR	5

5 rows × 25 columns

#显示头前5行数据
data.tail()

	action_type	combined_shot_type	game_event_id	game_id	lat	loc_x	loc_y	lon	minutes_remaining	period	...	shot_type	shot_zone_area	shot_zone_basic	shot_zone_range	team_id	team_name	game_date	matchup	opponent	shot_id
30692	Jump Shot	Jump Shot	397	49900088	33.9963	1	48	-118.2688	6	4	...	2PT Field Goal	Center(C)	In The Paint (Non-RA)	Less Than 8 ft.	1610612747	Los Angeles Lakers	2000/6/19	LAL vs. IND	IND	30693
30693	Tip Shot	Tip Shot	398	49900088	34.0443	0	0	-118.2698	6	4	...	2PT Field Goal	Center(C)	Restricted Area	Less Than 8 ft.	1610612747	Los Angeles Lakers	2000/6/19	LAL vs. IND	IND	30694
30694	Running Jump Shot	Jump Shot	426	49900088	33.8783	-134	166	-118.4038	3	4	...	2PT Field Goal	Left Side Center(LC)	Mid-Range	16-24 ft.	1610612747	Los Angeles Lakers	2000/6/19	LAL vs. IND	IND	30695
30695	Jump Shot	Jump Shot	448	49900088	33.7773	31	267	-118.2388	2	4	...	3PT Field Goal	Center(C)	Above the Break 3	24+ ft.	1610612747	Los Angeles Lakers	2000/6/19	LAL vs. IND	IND	30696
30696	Jump Shot	Jump Shot	471	49900088	33.9723	1	72	-118.2688	0	4	...	2PT Field Goal	Center(C)	In The Paint (Non-RA)	Less Than 8 ft.	1610612747	Los Angeles Lakers	2000/6/19	LAL vs. IND	IND	30697

5 rows × 25 columns

数据分析

投中与未中的数量

通过比较，正负样本的数量差不太多，但也存在一些数量上的差异，所以我将使用ROC和AUC进行模型评估

# 投中与未中的数量
yes=0
no=0
for i in data[pd.notnull(data['shot_made_flag'])]['shot_made_flag']:
    if i==1.0:
        yes+=1
    else:
        no+=1

plt.bar([0,1], [yes,no])
plt.xticks([0,1])
plt.show()

print('命中次数：',yes)
print('未命中次数：',no)

命中次数： 11465
未命中次数： 14232

数据清洗

用于处理标签值缺失的一些数据，和剔除对预测不相关和不重要的特征属性

a.标签缺失数据处理

#保留标签缺失值的数据
data_no = data[pd.isnull(data['shot_made_flag'])]
print(data_no.shape)

(5000, 25)

#保留标签不为缺失值的数据
data = data[pd.notnull(data['shot_made_flag'])]
print(data.shape)

(25697, 25)

b.坐标和经纬度特征重复

通过对数据的分析，发现特征既有科比投篮的位置坐标loc_x,loc_y又有经度lat，纬度lon，猜测这两组特征重复

画出坐标和经纬度的分布图，分析

通过比较，科比投篮的位置和经纬度这两组特征是类似的，保留一组特征即可。

#分配画布大小
plt.figure(figsize = (10,10))

plt.subplot(1,2,1)
#alpha为不透明度，loc_x，loc_y为科比投篮的位置
plt.scatter(data.loc_x,data.loc_y,color ='g',alpha = 0.05)
plt.title('loc_x and loc_y')
 
plt.subplot(1,2,2)
#lat为纬度，lon为经度
plt.scatter(data.lon,data.lat,color ='b',alpha = 0.05)
plt.title('lat and lon')

plt.show()

c.分钟与秒特征重复

原始特征中既有分钟又有秒，所以可以把这两组特征进行合并

data['remain_time'] = data['minutes_remaining']*60 + data['seconds_remaining']
data['remain_time'][:5]

1    622
2    465
3    412
4    379
5    572
Name: remain_time, dtype: int64

d.三种投篮位置表示重复

shot_zone_basic'，'shot_zone_basic'，'shot_zone_range' 这三个特征为投篮位置的不同表示，比较一下

画图分析，其形状与坐标位置差不多，所以我选用更加准确的坐标来表示投篮位置

import matplotlib.cm as cm
plt.figure(figsize=(20,10))
 
# data.groupyby(feature),是将数据根据feature里的类进行分类
def scatterbygroupby(feature):
    alpha = 0.1
    gb = data.groupby(feature)
    cl = cm.rainbow(np.linspace(0,1,len(gb)))
    for g,c in zip(gb,cl):
        plt.scatter(g[1].loc_x,g[1].loc_y,color = c,alpha = alpha)

plt.subplot(1,3,1)
scatterbygroupby('shot_zone_basic')
plt.title('shot_zone_basic')
 
plt.subplot(1,3,2)
scatterbygroupby('shot_zone_range')
plt.title('shot_zone_range')
 
plt.subplot(1,3,3)
scatterbygroupby('shot_zone_area')
plt.title('shot_zone_area')
plt.show()

e.去掉没用的特征属性

包括比赛id,球队id，team_name(科比只效力过洛杉矶湖人，所以可以删除)，其他的投篮位置的表示，分钟数，比赛时间等

剩余有用的特征：

action_type 进攻方式（更具体）
combined_shot_type 进攻方式
loc_x 投篮点
loc_y 投篮点
period 表示第几节
playoffs 是否是季后赛
season 赛季
shot_type 两分球或三分球
opponent 对手
remain_time 剩余时间

# 如比赛id,投篮id等无关特征
drops = ['combined_shot_type','shot_id', 'team_id', 'team_name', 'shot_zone_area', 'shot_zone_range', 'shot_zone_basic', \
         'matchup', 'lon', 'lat', 'seconds_remaining', 'minutes_remaining', \
         'shot_distance', 'game_event_id', 'game_id', 'game_date','season']
for drop in drops:
    data = data.drop(drop, 1)
data.head()

	action_type	loc_x	loc_y	period	shot_made_flag	shot_type	opponent	remain_time
1	Jump Shot	-157	0	1	0.0	2PT Field Goal	POR	622
2	Jump Shot	-101	135	1	1.0	2PT Field Goal	POR	465
3	Jump Shot	138	175	1	0.0	2PT Field Goal	POR	412
4	Driving Dunk Shot	0	0	2	1.0	2PT Field Goal	POR	379
5	Jump Shot	-145	-11	3	0.0	2PT Field Goal	POR	572

将文字特征转换为数字特征

我使用one-hot编码来实现

a = ['action_type', 'shot_type', 'opponent']
for i in a:
    #使用one-hot编码，将a中的特征里的属性值都当作新的特征附在数据的列上，特征名为前缀prefix加上该属性名
    data = pd.concat([data, pd.get_dummies(data[i], prefix=i)], 1)
    data = data.drop(i, 1) #0-行，1-列
data.head()

	loc_x	loc_y	period	shot_made_flag	remain_time	...	opponent_POR
1	-157	0	1	0.0	622	...	1
2	-101	135	1	1.0	465	...	1
3	138	175	1	0.0	412	...	1
4	0	0	2	1.0	379	...	1
5	-145	-11	3	0.0	572	...	1

5 rows × 96 columns

# 数据
data.shape

(25697, 96)

# 标签
data['shot_made_flag'].shape

(25697,)

保存一下处理后的数据

data.to_csv("./data_processed.csv", encoding="utf-8-sig", mode="w", header=True, index=False)

data = pd.read_csv("data_processed.csv")
data_label = data['shot_made_flag']

重新读取数据

#读入数据
data = pd.read_csv("data_processed.csv")
#显示大小
print("数据集大小:",data.shape)
# 数据集详细信息
print(data.info())

数据集大小: (25697, 96)
<class 'pandas.core.frame.DataFrame'>
RangeIndex: 25697 entries, 0 to 25696
Data columns (total 96 columns):
 #   Column                                       Non-Null Count  Dtype  
---  ------                                       --------------  -----  
 0   loc_x                                        25697 non-null  int64  
 1   loc_y                                        25697 non-null  int64  
 2   period                                       25697 non-null  int64  
 3   playoffs                                     25697 non-null  int64  
 4   shot_made_flag                               25697 non-null  float64
 5   remain_time                                  25697 non-null  int64  
 6   action_type_Alley Oop Dunk Shot              25697 non-null  int64  
 7   action_type_Alley Oop Layup shot             25697 non-null  int64  
 8   action_type_Cutting Layup Shot               25697 non-null  int64  
 9   action_type_Driving Bank shot                25697 non-null  int64  
 10  action_type_Driving Dunk Shot                25697 non-null  int64  
 11  action_type_Driving Finger Roll Layup Shot   25697 non-null  int64  
 12  action_type_Driving Finger Roll Shot         25697 non-null  int64  
 13  action_type_Driving Floating Bank Jump Shot  25697 non-null  int64  
 14  action_type_Driving Floating Jump Shot       25697 non-null  int64  
 15  action_type_Driving Hook Shot                25697 non-null  int64  
 16  action_type_Driving Jump shot                25697 non-null  int64  
 17  action_type_Driving Layup Shot               25697 non-null  int64  
 18  action_type_Driving Reverse Layup Shot       25697 non-null  int64  
 19  action_type_Driving Slam Dunk Shot           25697 non-null  int64  
 20  action_type_Dunk Shot                        25697 non-null  int64  
 21  action_type_Fadeaway Bank shot               25697 non-null  int64  
 22  action_type_Fadeaway Jump Shot               25697 non-null  int64  
 23  action_type_Finger Roll Layup Shot           25697 non-null  int64  
 24  action_type_Finger Roll Shot                 25697 non-null  int64  
 25  action_type_Floating Jump shot               25697 non-null  int64  
 26  action_type_Follow Up Dunk Shot              25697 non-null  int64  
 27  action_type_Hook Bank Shot                   25697 non-null  int64  
 28  action_type_Hook Shot                        25697 non-null  int64  
 29  action_type_Jump Bank Shot                   25697 non-null  int64  
 30  action_type_Jump Hook Shot                   25697 non-null  int64  
 31  action_type_Jump Shot                        25697 non-null  int64  
 32  action_type_Layup Shot                       25697 non-null  int64  
 33  action_type_Pullup Bank shot                 25697 non-null  int64  
 34  action_type_Pullup Jump shot                 25697 non-null  int64  
 35  action_type_Putback Dunk Shot                25697 non-null  int64  
 36  action_type_Putback Layup Shot               25697 non-null  int64  
 37  action_type_Putback Slam Dunk Shot           25697 non-null  int64  
 38  action_type_Reverse Dunk Shot                25697 non-null  int64  
 39  action_type_Reverse Layup Shot               25697 non-null  int64  
 40  action_type_Reverse Slam Dunk Shot           25697 non-null  int64  
 41  action_type_Running Bank shot                25697 non-null  int64  
 42  action_type_Running Dunk Shot                25697 non-null  int64  
 43  action_type_Running Finger Roll Layup Shot   25697 non-null  int64  
 44  action_type_Running Finger Roll Shot         25697 non-null  int64  
 45  action_type_Running Hook Shot                25697 non-null  int64  
 46  action_type_Running Jump Shot                25697 non-null  int64  
 47  action_type_Running Layup Shot               25697 non-null  int64  
 48  action_type_Running Pull-Up Jump Shot        25697 non-null  int64  
 49  action_type_Running Reverse Layup Shot       25697 non-null  int64  
 50  action_type_Running Slam Dunk Shot           25697 non-null  int64  
 51  action_type_Running Tip Shot                 25697 non-null  int64  
 52  action_type_Slam Dunk Shot                   25697 non-null  int64  
 53  action_type_Step Back Jump shot              25697 non-null  int64  
 54  action_type_Tip Layup Shot                   25697 non-null  int64  
 55  action_type_Tip Shot                         25697 non-null  int64  
 56  action_type_Turnaround Bank shot             25697 non-null  int64  
 57  action_type_Turnaround Fadeaway shot         25697 non-null  int64  
 58  action_type_Turnaround Finger Roll Shot      25697 non-null  int64  
 59  action_type_Turnaround Hook Shot             25697 non-null  int64  
 60  action_type_Turnaround Jump Shot             25697 non-null  int64  
 61  shot_type_2PT Field Goal                     25697 non-null  int64  
 62  shot_type_3PT Field Goal                     25697 non-null  int64  
 63  opponent_ATL                                 25697 non-null  int64  
 64  opponent_BKN                                 25697 non-null  int64  
 65  opponent_BOS                                 25697 non-null  int64  
 66  opponent_CHA                                 25697 non-null  int64  
 67  opponent_CHI                                 25697 non-null  int64  
 68  opponent_CLE                                 25697 non-null  int64  
 69  opponent_DAL                                 25697 non-null  int64  
 70  opponent_DEN                                 25697 non-null  int64  
 71  opponent_DET                                 25697 non-null  int64  
 72  opponent_GSW                                 25697 non-null  int64  
 73  opponent_HOU                                 25697 non-null  int64  
 74  opponent_IND                                 25697 non-null  int64  
 75  opponent_LAC                                 25697 non-null  int64  
 76  opponent_MEM                                 25697 non-null  int64  
 77  opponent_MIA                                 25697 non-null  int64  
 78  opponent_MIL                                 25697 non-null  int64  
 79  opponent_MIN                                 25697 non-null  int64  
 80  opponent_NJN                                 25697 non-null  int64  
 81  opponent_NOH                                 25697 non-null  int64  
 82  opponent_NOP                                 25697 non-null  int64  
 83  opponent_NYK                                 25697 non-null  int64  
 84  opponent_OKC                                 25697 non-null  int64  
 85  opponent_ORL                                 25697 non-null  int64  
 86  opponent_PHI                                 25697 non-null  int64  
 87  opponent_PHX                                 25697 non-null  int64  
 88  opponent_POR                                 25697 non-null  int64  
 89  opponent_SAC                                 25697 non-null  int64  
 90  opponent_SAS                                 25697 non-null  int64  
 91  opponent_SEA                                 25697 non-null  int64  
 92  opponent_TOR                                 25697 non-null  int64  
 93  opponent_UTA                                 25697 non-null  int64  
 94  opponent_VAN                                 25697 non-null  int64  
 95  opponent_WAS                                 25697 non-null  int64  
dtypes: float64(1), int64(95)
memory usage: 18.8 MB
None

分离特征和标签

data_feature = data.drop('shot_made_flag',1)
data_label = data['shot_made_flag']
data_label.shape

(25697,)

no=0
yes=0
for i in data['shot_made_flag']:
    if i==0.0:
        no+=1
    else:
        yes+=1
print('没有投进的次数：',no)
print('投进的次数：',yes)

没有投进的次数： 14232
投进的次数： 11465

data_label = np.array(data_label)
data_label.shape

(25697,)

数据标准化

由于各个特征之间存在很大的量纲上的差异，所以先进行标准化

from sklearn.preprocessing import StandardScaler
scaler = StandardScaler()
data_feature = scaler.fit_transform(data_feature)

data_feature = pd.DataFrame(data_feature)
data_feature.head()

	0	1	2	3	4	5	6	7	8	9	...	85	86	87	88	89	90	91	92	93	94
0	-1.491296	-1.035246	-1.320593	-0.413876	1.442489	-0.060915	-0.051129	-0.015282	-0.010805	-0.100510	...	-0.155015	-0.252051	4.346184	-0.23977	-0.260926	-0.166603	-0.148712	-0.224978	-0.089455	-0.141011
1	-0.982533	0.496228	-1.320593	-0.413876	0.688794	-0.060915	-0.051129	-0.015282	-0.010805	-0.100510	...	-0.155015	-0.252051	4.346184	-0.23977	-0.260926	-0.166603	-0.148712	-0.224978	-0.089455	-0.141011
2	1.188792	0.949998	-1.320593	-0.413876	0.434362	-0.060915	-0.051129	-0.015282	-0.010805	-0.100510	...	-0.155015	-0.252051	4.346184	-0.23977	-0.260926	-0.166603	-0.148712	-0.224978	-0.089455	-0.141011
3	-0.064944	-1.035246	-0.452239	-0.413876	0.275942	-0.060915	-0.051129	-0.015282	-0.010805	9.949288	...	-0.155015	-0.252051	4.346184	-0.23977	-0.260926	-0.166603	-0.148712	-0.224978	-0.089455	-0.141011
4	-1.382275	-1.160033	0.416115	-0.413876	1.202459	-0.060915	-0.051129	-0.015282	-0.010805	-0.100510	...	-0.155015	-0.252051	4.346184	-0.23977	-0.260926	-0.166603	-0.148712	-0.224978	-0.089455	-0.141011

5 rows × 95 columns

data_feature.to_csv("./data_feature_standard.csv", encoding="utf-8-sig", mode="w", header=True, index=False)

data_feature = pd.read_csv("data_feature_standard.csv")

5.模型训练与调优

我准备使用KNN算法、决策树和支持向量机等传统机器学习算法进行分类

一、KNN算法

载入数据和标签

knn_data = data_feature
knn_label = data_label

构建训练（train）和测试数据(test)

from sklearn.model_selection import train_test_split
X_train, X_test, y_train, y_test = train_test_split(knn_data,knn_label, random_state=2020, test_size=0.25)

构建和训练模型

from sklearn.neighbors import KNeighborsClassifier
knn = KNeighborsClassifier(n_neighbors=3)
knn.fit(X_train, y_train)

KNeighborsClassifier(algorithm='auto', leaf_size=30, metric='minkowski',
                     metric_params=None, n_jobs=None, n_neighbors=3, p=2,
                     weights='uniform')

训练测试准确率

score = knn.score(X_train, y_train)
print('训练数据集的准确率：{:.3}%'.format(score*100))
score = knn.score(X_test, y_test)
print('测试数据集的准确率：{:.3}%'.format(score*100))

训练数据集的准确率：79.3%
测试数据集的准确率：60.5%

参数调优

# 交叉验证
from sklearn.model_selection import cross_val_score
from time import time
import datetime
k_range = range(1,21,2)
cv_scores = []
time0 = time()
for n in k_range:
    knn = KNeighborsClassifier(n_neighbors=n)
    scores = cross_val_score(knn,X_train,y_train,cv=10,scoring='accuracy')
    cv_scores.append(scores.mean())
print('计算所用时长：%s' % (datetime.datetime.fromtimestamp(time()-time0).strftime("%M:%S:%f")))
print('最高准确率:',max(cv_scores),',对应的k值为:',k_range[cv_scores.index(max(cv_scores))])
plt.plot(k_range,cv_scores)
plt.xlabel('K')
plt.ylabel('Accuracy')
plt.show()

计算所用时长：09:49:771366
最高准确率: 0.6548897841763798 ,对应的k值为: 19

# 进一步
k_range = range(11,23,2)
cv_scores = []
time0 = time()
for n in k_range:
    knn = KNeighborsClassifier(n_neighbors=n)
    scores = cross_val_score(knn,X_train,y_train,cv=10,scoring='accuracy')
    cv_scores.append(scores.mean())
print('计算所用时长：%s' % (datetime.datetime.fromtimestamp(time()-time0).strftime("%M:%S:%f")))
print('最高准确率:',max(cv_scores),',对应的k值为:',k_range[cv_scores.index(max(cv_scores))])
plt.plot(k_range,cv_scores)
plt.xlabel('K')
plt.ylabel('Accuracy')
plt.show()

计算所用时长：06:04:127228
最高准确率: 0.6548897841763798 ,对应的k值为: 19

测试集评估

knn = KNeighborsClassifier(n_neighbors=19)
knn.fit(X_train, y_train)
score = knn.score(X_train, y_train)
print('训练数据集的准确率：{:.3}%'.format(score*100))
score = knn.score(X_test, y_test)
print('测试数据集的准确率：{:.3}%'.format(score*100))

训练数据集的准确率：69.1%
测试数据集的准确率：65.4%

# 绘制混淆矩阵
from sklearn.metrics import confusion_matrix
y_pred = knn.predict(X_test)
c2= confusion_matrix(y_test, y_pred, labels=[0, 1])
c2

array([[2872,  636],
       [1586, 1331]], dtype=int64)

# ROC
from sklearn.metrics import roc_curve, auc, roc_auc_score
from sklearn.preprocessing import label_binarize
# y_test_hot = label_binarize(y_test, classes=(0, 1))
knn_y_score = knn.predict_proba(X_test)
knn_fpr, knn_tpr, _ = roc_curve(y_test,knn_y_score[:,1], pos_label=1)
plt.plot(knn_fpr, knn_tpr,
         label='micro-average ROC curve',
         color='g', linewidth=4)
plt.plot([0, 1], [0, 1], 'k--', lw=2,c='r')
plt.title('knn roc')
plt.show()

# AUC
knn_auc = auc(knn_fpr, knn_tpr)
knn_auc

0.6722211711396529

保存模型

from sklearn.externals import joblib
# 保存模型
joblib.dump(knn,"knn_model.h5")

# 模型加载
# knn = joblib.load("knn_model.h5")

D:\programming_software_install\Anaconda3\lib\site-packages\sklearn\externals\joblib\__init__.py:15: FutureWarning: sklearn.externals.joblib is deprecated in 0.21 and will be removed in 0.23. Please import this functionality directly from joblib, which can be installed with: pip install joblib. If this warning is raised when loading pickled models, you may need to re-serialize those models with scikit-learn 0.21+.
  warnings.warn(msg, category=FutureWarning)





['knn_model.h5']

总结

knn算法可以预测准确率达到65.4%，有一点低

二、决策树算法

载入数据

tree_data = data_feature
tree_label = data_label

划分数据

from sklearn.model_selection import train_test_split
X_train, X_test, y_train, y_test = train_test_split(tree_data,tree_label, random_state=2020, test_size=0.25)

模型创建与训练

from sklearn.tree import DecisionTreeClassifier

'''
DecisionTreeClassifier() 模型方法中也包含非常多的参数值。例如：
criterion = gini/entropy 可以用来选择用基尼指数或者熵来做损失函数。
splitter = best/random 用来确定每个节点的分裂策略。支持“最佳”或者“随机”。
max_depth = int 用来控制决策树的最大深度，防止模型出现过拟合。
min_samples_leaf = int 用来设置叶节点上的最少样本数量，用于对树进行修剪。
'''

dt_model= DecisionTreeClassifier()  # 所以参数均置为默认状态
dt_model.fit(X_train, y_train)  # 使用训练集训练模型
predict_results = dt_model.predict(X_test)  # 使用模型对测试集进行预测
score = dt_model.score(X_test,y_test)
score

0.5833463035019455

模型调优

使用网格搜索对参数进行调整

from sklearn.model_selection import GridSearchCV
param_grid = {"criterion":["gini","entropy"], "max_depth":[2,3,4,5,6,8],"min_samples_leaf":[1,2,3,4,5]}
grid_search = GridSearchCV(DecisionTreeClassifier(),param_grid,cv=5) #实例化一个GridSearchCV类
grid_search.fit(X_train, y_train)
print("Best score on train set:{:.5f}".format(grid_search.best_score_))
print("Test set score:{:.5f}".format(grid_search.score(X_test,y_test)))
print("Best parameters:{}".format(grid_search.best_params_))

Best score on train set:0.68016
Test set score:0.67440
Best parameters:{'criterion': 'gini', 'max_depth': 2, 'min_samples_leaf': 1}

模型评估

from sklearn.tree import DecisionTreeClassifier
dt = DecisionTreeClassifier(criterion= 'gini', max_depth=2, min_samples_leaf= 1)
dt.fit(X_train, y_train)

DecisionTreeClassifier(ccp_alpha=0.0, class_weight=None, criterion='gini',
                       max_depth=2, max_features=None, max_leaf_nodes=None,
                       min_impurity_decrease=0.0, min_impurity_split=None,
                       min_samples_leaf=1, min_samples_split=2,
                       min_weight_fraction_leaf=0.0, presort='deprecated',
                       random_state=None, splitter='best')

# 混淆矩阵
y_pred = dt.predict(X_test)
c2= confusion_matrix(y_test, y_pred, labels=[0, 1])
c2

[1. 0. 0. ... 1. 0. 0.]





array([[2947,  561],
       [1531, 1386]], dtype=int64)

# ROC
dt_y_score = knn.predict_proba(X_test)
dt_fpr, dt_tpr, _ = roc_curve(y_test,dt_y_score[:,1], pos_label=1)
plt.plot(dt_fpr, dt_tpr,
         label='micro-average ROC curve',
         color='g', linewidth=4)
plt.plot([0, 1], [0, 1], 'k--', lw=2,c='r')
plt.title('dt roc')
plt.show()

# AUC
dt_auc = auc(dt_fpr, dt_tpr)
dt_auc

0.6722211711396529

保存模型

joblib.dump(dt,"dt_model.h5")

['dt_model.h5']

总结

决策树可以达到67.4%，比knn提高了一点点

三、随机森林算法

载入数据

rf_data = data_feature
rf_label = data_label

划分数据

X_train,X_test,y_train,y_test = train_test_split(rf_data, rf_label, test_size=0.25, random_state=2020)

网格搜索找最优参数

import warnings 
warnings.filterwarnings('ignore')
from sklearn.ensemble import RandomForestClassifier
from sklearn.model_selection import GridSearchCV

param_grid = {"n_estimators":np.arange(10,30,1),"criterion":['entory','gini'], "max_depth":[2,3,4,5,6],"min_samples_leaf":[1,2,3]}
grid_search = GridSearchCV(RandomForestClassifier(),param_grid,cv=5) #实例化一个GridSearchCV类
grid_search.fit(X_train, y_train)

print("Best score on train set:{:.5f}".format(grid_search.best_score_))
print("Test set score:{:.5f}".format(grid_search.score(X_test,y_test)))
print("Best parameters:{}".format(grid_search.best_params_))

Best score on train set:0.67404
Test set score:0.66101
Best parameters:{'criterion': 'gini', 'max_depth': 6, 'min_samples_leaf': 2, 'n_estimators': 20}

模型训练

from sklearn.ensemble import RandomForestClassifier
rf = RandomForestClassifier(criterion='gini',n_estimators=20,max_depth=6,min_samples_leaf=2)
rf.fit(X_train,y_train)

RandomForestClassifier(bootstrap=True, ccp_alpha=0.0, class_weight=None,
                       criterion='gini', max_depth=6, max_features='auto',
                       max_leaf_nodes=None, max_samples=None,
                       min_impurity_decrease=0.0, min_impurity_split=None,
                       min_samples_leaf=2, min_samples_split=2,
                       min_weight_fraction_leaf=0.0, n_estimators=20,
                       n_jobs=None, oob_score=False, random_state=None,
                       verbose=0, warm_start=False)

score = rf.score(X_test, y_test)
score

0.6647470817120622

保存模型

from sklearn.externals import joblib
joblib.dump(rf,"rf_model.h5")

['rf_model.h5']

模型评估

from sklearn.metrics import confusion_matrix
from sklearn.metrics import roc_curve, auc, roc_auc_score
from sklearn.preprocessing import label_binarize
# 混淆矩阵
y_pred = rf.predict(X_test)
c2= confusion_matrix(y_test, y_pred, labels=[0, 1])
c2

array([[2871,  637],
       [1517, 1400]], dtype=int64)

# ROC
rf_y_score = rf.predict_proba(X_test)
rf_fpr, rf_tpr, _ = roc_curve(y_test,rf_y_score[:,1], pos_label=1)
plt.plot(rf_fpr, rf_tpr,
         label='micro-average ROC curve',
         color='g', linewidth=4)
plt.plot([0, 1], [0, 1], 'k--', lw=2,c='r')
plt.title('rf roc')
plt.show()

# AUC
rf_auc = auc(rf_fpr, rf_tpr)
rf_auc

0.683775641474172

四、支持向量机算法

载入数据

svm_data = data_feature
svm_label = data_label

划分数据

from sklearn.model_selection import train_test_split
X_train,X_test,y_train,y_test = train_test_split(svm_data, svm_label, test_size=0.25, random_state=2020)

模型训练与调优

from sklearn.svm import SVC
svm = SVC(kernel='rbf')
svm.fit(X_train, y_train)
score = svm.score(X_test,y_test)
score

0.674396887159533

# rbf
from sklearn.svm import SVC
best_score = 0
C = [0.6,0.8,1.0]
for  c in C:
    print('...',c,'...')
    svm = SVC(kernel='rbf',C=c)
    svm.fit(X_train, y_train)
    score = svm.score(X_test, y_test)
    if score>best_score:
        best_score = score
        best_kernel = None
        best_c = c
print('best_score:',best_score)
print('best_c:',best_c)

... 0.6 ...
... 0.8 ...
... 1.0 ...
best_score: 0.6754863813229572
best_c: 0.6

gamma_range = np.logspace(-5, 1, 50)
score = []
for i in gamma_range:
    print('...gamma:',i,'...')
    svm = SVC(kernel='rbf', gamma=i, cache_size=5000).fit(X_train, y_train)
    score.append(svm.score(X_test, y_test))
print('最大准确率：', max(score), ' 对应gamma值：', gamma_range[score.index(max(score))])
plt.plot(gamma_range, score)
plt.show()

...gamma: 1e-05 ...
...gamma: 1.3257113655901082e-05 ...
...gamma: 1.757510624854793e-05 ...
...gamma: 2.3299518105153718e-05 ...
...gamma: 3.0888435964774785e-05 ...
...gamma: 4.094915062380427e-05 ...
...gamma: 5.4286754393238594e-05 ...
...gamma: 7.196856730011514e-05 ...
...gamma: 9.540954763499944e-05 ...
...gamma: 0.00012648552168552957 ...
...gamma: 0.00016768329368110083 ...
...gamma: 0.00022229964825261955 ...
...gamma: 0.00029470517025518097 ...
...gamma: 0.0003906939937054617 ...
...gamma: 0.0005179474679231213 ...
...gamma: 0.0006866488450042998 ...
...gamma: 0.0009102981779915217 ...
...gamma: 0.0012067926406393288 ...
...gamma: 0.0015998587196060573 ...
...gamma: 0.0021209508879201904 ...
...gamma: 0.002811768697974231 ...
...gamma: 0.003727593720314938 ...
...gamma: 0.004941713361323833 ...
...gamma: 0.006551285568595509 ...
...gamma: 0.00868511373751352 ...
...gamma: 0.01151395399326447 ...
...gamma: 0.015264179671752334 ...
...gamma: 0.020235896477251575 ...
...gamma: 0.026826957952797246 ...
...gamma: 0.03556480306223128 ...
...gamma: 0.04714866363457394 ...
...gamma: 0.0625055192527397 ...
...gamma: 0.08286427728546843 ...
...gamma: 0.10985411419875572 ...
...gamma: 0.14563484775012445 ...
...gamma: 0.19306977288832497 ...
...gamma: 0.2559547922699533 ...
...gamma: 0.33932217718953295 ...
...gamma: 0.4498432668969444 ...
...gamma: 0.5963623316594636 ...
...gamma: 0.7906043210907702 ...
...gamma: 1.0481131341546852 ...
...gamma: 1.389495494373136 ...
...gamma: 1.8420699693267164 ...
...gamma: 2.44205309454865 ...
...gamma: 3.2374575428176398 ...
...gamma: 4.291934260128778 ...
...gamma: 5.689866029018293 ...
...gamma: 7.543120063354607 ...
...gamma: 10.0 ...
最大准确率： 0.6768871595330739  对应gamma值： 0.0021209508879201904

from sklearn.svm import SVC
svm = SVC(kernel='rbf', gamma=0.0021209508879201904, cache_size=5000,C=0.6).fit(X_train, y_train)

score = svm.score(X_test,y_test)
score

0.6765758754863813

模型保存

from sklearn.externals import joblib
joblib.dump(svm,"svm_model.h5")

['svm_model.h5']

模型评估

from sklearn.metrics import confusion_matrix
from sklearn.metrics import roc_curve, auc, roc_auc_score
from sklearn.preprocessing import label_binarize
# 混淆矩阵
y_pred = svm.predict(X_test)
c2= confusion_matrix(y_test, y_pred, labels=[0, 1])
c2

array([[2989,  519],
       [1559, 1358]], dtype=int64)

# ROC
svm_y_score = svm.decision_function(X_test)

svm_fpr, svm_tpr, _ = roc_curve(y_test,svm_y_score, pos_label=1)
plt.scatter(svm_fpr, svm_tpr,
         label='micro-average ROC curve',
         color='g', linewidth=1)
plt.plot([0, 1], [0, 1], 'k--', lw=2,c='r')
plt.title('svm roc')
plt.show()

# AUC
svm_auc = auc(svm_fpr, svm_tpr)
svm_auc

0.6695905709814952

传统机器学习总结

使用传统的机器学习算法得到的准确率都不是很高，这和数据集有很大的关系，所以我准备使用深度学习的卷积神经网络来试一试

五、神经网络

载入数据

cnn_data = np.asarray(data_feature)
cnn_label = np.asarray(data_label)

cnn_data.shape

(25697, 95)

划分数据

x_train = cnn_data[:20000]
y_train = cnn_label[:20000]
x_test = cnn_data[20000:]
y_test = cnn_label[20000:]

生成卷积网络

from keras import models
from keras import layers

model = models.Sequential()
model.add(layers.Dense(16,activation='relu',input_shape=(95,)))
model.add(layers.Dense(16,activation='relu'))
model.add(layers.Dense(1,activation='sigmoid'))

model.summary()

Model: "sequential_5"
_________________________________________________________________
Layer (type)                 Output Shape              Param #   
=================================================================
dense_13 (Dense)             (None, 16)                1536      
_________________________________________________________________
dense_14 (Dense)             (None, 16)                272       
_________________________________________________________________
dense_15 (Dense)             (None, 1)                 17        
=================================================================
Total params: 1,825
Trainable params: 1,825
Non-trainable params: 0
_________________________________________________________________

模型编译

model.compile(optimizer = 'rmsprop',
             loss='binary_crossentropy',
             metrics=['accuracy'])

划分训练和验证数据

x_val = x_train[:7000]
partial_x_train = x_train[7000:]

y_val = y_train[:7000]
partial_y_train = y_train[7000:]

模型训练

history = model.fit(partial_x_train,
                    partial_y_train,
                    epochs=20,
                    batch_size=512,
         validation_data=(x_val,y_val))

Train on 13000 samples, validate on 7000 samples
Epoch 1/20
13000/13000 [==============================] - 0s 18us/step - loss: 0.7142 - accuracy: 0.5549 - val_loss: 0.6703 - val_accuracy: 0.5967
Epoch 2/20
13000/13000 [==============================] - 0s 8us/step - loss: 0.6630 - accuracy: 0.6285 - val_loss: 0.6502 - val_accuracy: 0.6489
Epoch 3/20
13000/13000 [==============================] - 0s 8us/step - loss: 0.6424 - accuracy: 0.6572 - val_loss: 0.6391 - val_accuracy: 0.6690
Epoch 4/20
13000/13000 [==============================] - 0s 9us/step - loss: 0.6309 - accuracy: 0.6677 - val_loss: 0.6320 - val_accuracy: 0.6741
Epoch 5/20
13000/13000 [==============================] - 0s 9us/step - loss: 0.6237 - accuracy: 0.6722 - val_loss: 0.6279 - val_accuracy: 0.6781
Epoch 6/20
13000/13000 [==============================] - 0s 8us/step - loss: 0.6192 - accuracy: 0.6746 - val_loss: 0.6247 - val_accuracy: 0.6803
Epoch 7/20
13000/13000 [==============================] - 0s 9us/step - loss: 0.6160 - accuracy: 0.6782 - val_loss: 0.6225 - val_accuracy: 0.6804
Epoch 8/20
13000/13000 [==============================] - 0s 9us/step - loss: 0.6134 - accuracy: 0.6791 - val_loss: 0.6208 - val_accuracy: 0.6803
Epoch 9/20
13000/13000 [==============================] - 0s 8us/step - loss: 0.6114 - accuracy: 0.6804 - val_loss: 0.6193 - val_accuracy: 0.6817
Epoch 10/20
13000/13000 [==============================] - 0s 9us/step - loss: 0.6096 - accuracy: 0.6800 - val_loss: 0.6181 - val_accuracy: 0.6829
Epoch 11/20
13000/13000 [==============================] - 0s 8us/step - loss: 0.6086 - accuracy: 0.6802 - val_loss: 0.6174 - val_accuracy: 0.6819
Epoch 12/20
13000/13000 [==============================] - 0s 9us/step - loss: 0.6074 - accuracy: 0.6793 - val_loss: 0.6165 - val_accuracy: 0.6833
Epoch 13/20
13000/13000 [==============================] - 0s 9us/step - loss: 0.6064 - accuracy: 0.6807 - val_loss: 0.6162 - val_accuracy: 0.6823
Epoch 14/20
13000/13000 [==============================] - 0s 10us/step - loss: 0.6055 - accuracy: 0.6810 - val_loss: 0.6157 - val_accuracy: 0.6831
Epoch 15/20
13000/13000 [==============================] - 0s 9us/step - loss: 0.6047 - accuracy: 0.6821 - val_loss: 0.6150 - val_accuracy: 0.6824
Epoch 16/20
13000/13000 [==============================] - 0s 9us/step - loss: 0.6040 - accuracy: 0.6812 - val_loss: 0.6148 - val_accuracy: 0.6829
Epoch 17/20
13000/13000 [==============================] - 0s 8us/step - loss: 0.6032 - accuracy: 0.6821 - val_loss: 0.6153 - val_accuracy: 0.6820
Epoch 18/20
13000/13000 [==============================] - 0s 9us/step - loss: 0.6027 - accuracy: 0.6819 - val_loss: 0.6146 - val_accuracy: 0.6807
Epoch 19/20
13000/13000 [==============================] - 0s 9us/step - loss: 0.6020 - accuracy: 0.6828 - val_loss: 0.6145 - val_accuracy: 0.6811
Epoch 20/20
13000/13000 [==============================] - 0s 7us/step - loss: 0.6017 - accuracy: 0.6826 - val_loss: 0.6142 - val_accuracy: 0.6806

history_dict = history.history
history_dict.keys()

dict_keys(['val_loss', 'val_accuracy', 'loss', 'accuracy'])

results = model.evaluate(x_test,y_test)

5697/5697 [==============================] - 0s 21us/step

results

[0.6219044832340432, 0.6782516837120056]

模型调优

epoch在大约17的时候可能会好一点

loss_values = history_dict['loss']
val_loss_values = history_dict['val_loss']
epochs = range(1,len(loss_values)+1)
plt.plot(epochs,loss_values,'bo',label='Training loss')
plt.plot(epochs,val_loss_values,'b',label='Validation loss')
plt.title('Trian and Validation loss')
plt.xlabel('Epochs')
plt.ylabel('Loss')
plt.legend()
plt.show()

acc = history_dict['accuracy']
val_acc = history_dict['val_accuracy']
plt.plot(epochs,acc,'bo',label='Training acc')
plt.plot(epochs,val_acc,'b',label='Validation acc')
plt.title('Trian and Validation acc')
plt.xlabel('Epochs')
plt.ylabel('acc')
plt.legend()
plt.show()

预测测试数据，评估模型

nums1 = [16,32,64]
nums2 = [16,32,64]
epochs = [7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30]
best_result = 0
best_param = []
for num1 in nums1:
    for num2 in nums2:
        for epoch in epochs:
            model = models.Sequential()
            model.add(layers.Dense(num1,activation='relu',input_shape=(95,)))
            model.add(layers.Dense(num2,activation='relu'))
            model.add(layers.Dense(1,activation='sigmoid'))

            model.compile(optimizer = 'rmsprop',
                         loss='binary_crossentropy',
                         metrics=['accuracy'])

            history = model.fit(x_train,y_train,epochs=epoch,batch_size=512)

            results = model.evaluate(x_test,y_test)
            if best_result<results[1]:
                best_result = results[1]
                best_param = []
                best_param.append(num1)
                best_param.append(num2)
                best_param.append(epoch)

Epoch 1/7
20000/20000 [==============================] - 0s 11us/step - loss: 0.6775 - accuracy: 0.6025
Epoch 2/7
20000/20000 [==============================] - 0s 6us/step - loss: 0.6390 - accuracy: 0.6525
Epoch 3/7
20000/20000 [==============================] - 0s 6us/step - loss: 0.6253 - accuracy: 0.6678
Epoch 4/7
20000/20000 [==============================] - 0s 6us/step - loss: 0.6183 - accuracy: 0.6737
Epoch 5/7
20000/20000 [==============================] - 0s 6us/step - loss: 0.6139 - accuracy: 0.6777
Epoch 6/7
20000/20000 [==============================] - 0s 6us/step - loss: 0.6110 - accuracy: 0.6797
Epoch 7/7
20000/20000 [==============================] - 0s 6us/step - loss: 0.6086 - accuracy: 0.6809
5697/5697 [==============================] - 0s 22us/step
Epoch 1/8
20000/20000 [==============================] - 0s 11us/step - loss: 0.6996 - accuracy: 0.5670
Epoch 2/8
20000/20000 [==============================] - 0s 6us/step - loss: 0.6453 - accuracy: 0.6495
Epoch 3/8
20000/20000 [==============================] - 0s 6us/step - loss: 0.6255 - accuracy: 0.6729
Epoch 4/8
20000/20000 [==============================] - 0s 8us/step - loss: 0.6171 - accuracy: 0.6794
Epoch 5/8
20000/20000 [==============================] - 0s 7us/step - loss: 0.6127 - accuracy: 0.6809
Epoch 6/8
20000/20000 [==============================] - 0s 6us/step - loss: 0.6098 - accuracy: 0.6816
Epoch 7/8
20000/20000 [==============================] - 0s 6us/step - loss: 0.6078 - accuracy: 0.6819
Epoch 8/8
20000/20000 [==============================] - 0s 6us/step - loss: 0.6062 - accuracy: 0.6822
5697/5697 [==============================] - 0s 24us/step
Epoch 1/9
20000/20000 [==============================] - 0s 11us/step - loss: 0.6914 - accuracy: 0.5633
Epoch 2/9
20000/20000 [==============================] - 0s 6us/step - loss: 0.6529 - accuracy: 0.6464
Epoch 3/9
20000/20000 [==============================] - 0s 6us/step - loss: 0.6336 - accuracy: 0.6693
Epoch 4/9
20000/20000 [==============================] - 0s 6us/step - loss: 0.6220 - accuracy: 0.6787
Epoch 5/9
20000/20000 [==============================] - 0s 7us/step - loss: 0.6152 - accuracy: 0.6809
Epoch 6/9
20000/20000 [==============================] - 0s 7us/step - loss: 0.6114 - accuracy: 0.6812
Epoch 7/9
20000/20000 [==============================] - 0s 6us/step - loss: 0.6088 - accuracy: 0.6812
Epoch 8/9
20000/20000 [==============================] - 0s 7us/step - loss: 0.6070 - accuracy: 0.6810
Epoch 9/9
20000/20000 [==============================] - 0s 6us/step - loss: 0.6057 - accuracy: 0.6812
5697/5697 [==============================] - 0s 22us/step
Epoch 1/10
20000/20000 [==============================] - 0s 23us/step - loss: 0.6777 - accuracy: 0.6018
Epoch 2/10
20000/20000 [==============================] - 0s 7us/step - loss: 0.6435 - accuracy: 0.6565
Epoch 3/10
20000/20000 [==============================] - 0s 9us/step - loss: 0.6273 - accuracy: 0.6732
Epoch 4/10
20000/20000 [==============================] - 0s 7us/step - loss: 0.6189 - accuracy: 0.6762
Epoch 5/10
20000/20000 [==============================] - 0s 7us/step - loss: 0.6136 - accuracy: 0.6783
Epoch 6/10
20000/20000 [==============================] - 0s 7us/step - loss: 0.6104 - accuracy: 0.6796
Epoch 7/10
20000/20000 [==============================] - 0s 6us/step - loss: 0.6084 - accuracy: 0.6811
Epoch 8/10
20000/20000 [==============================] - 0s 6us/step - loss: 0.6069 - accuracy: 0.6816
Epoch 9/10
20000/20000 [==============================] - 0s 6us/step - loss: 0.6057 - accuracy: 0.6821
Epoch 10/10
20000/20000 [==============================] - 0s 7us/step - loss: 0.6047 - accuracy: 0.6823
5697/5697 [==============================] - 0s 28us/step
Epoch 1/11
20000/20000 [==============================] - 0s 11us/step - loss: 0.6886 - accuracy: 0.5547
Epoch 2/11
20000/20000 [==============================] - 0s 6us/step - loss: 0.6508 - accuracy: 0.6492
Epoch 3/11
20000/20000 [==============================] - 0s 7us/step - loss: 0.6317 - accuracy: 0.6690
Epoch 4/11
20000/20000 [==============================] - 0s 6us/step - loss: 0.6200 - accuracy: 0.6766
Epoch 5/11
20000/20000 [==============================] - 0s 6us/step - loss: 0.6138 - accuracy: 0.6791
Epoch 6/11
20000/20000 [==============================] - 0s 7us/step - loss: 0.6100 - accuracy: 0.6800
Epoch 7/11
20000/20000 [==============================] - 0s 7us/step - loss: 0.6077 - accuracy: 0.6817
Epoch 8/11
20000/20000 [==============================] - 0s 6us/step - loss: 0.6061 - accuracy: 0.6830
Epoch 9/11
20000/20000 [==============================] - 0s 6us/step - loss: 0.6048 - accuracy: 0.6833
Epoch 10/11
20000/20000 [==============================] - 0s 6us/step - loss: 0.6039 - accuracy: 0.6827
Epoch 11/11
20000/20000 [==============================] - 0s 6us/step - loss: 0.6032 - accuracy: 0.6835
5697/5697 [==============================] - 0s 30us/step
Epoch 1/12
20000/20000 [==============================] - 0s 11us/step - loss: 0.7349 - accuracy: 0.5123
Epoch 2/12
20000/20000 [==============================] - 0s 6us/step - loss: 0.6568 - accuracy: 0.6397
Epoch 3/12
20000/20000 [==============================] - 0s 7us/step - loss: 0.6361 - accuracy: 0.6684
Epoch 4/12
20000/20000 [==============================] - 0s 6us/step - loss: 0.6247 - accuracy: 0.6773
Epoch 5/12
20000/20000 [==============================] - 0s 6us/step - loss: 0.6182 - accuracy: 0.6790
Epoch 6/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6143 - accuracy: 0.6797
Epoch 7/12
20000/20000 [==============================] - 0s 6us/step - loss: 0.6116 - accuracy: 0.6812
Epoch 8/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6095 - accuracy: 0.6815
Epoch 9/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6079 - accuracy: 0.6823
Epoch 10/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6065 - accuracy: 0.6830
Epoch 11/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6053 - accuracy: 0.6821
Epoch 12/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6043 - accuracy: 0.6830
5697/5697 [==============================] - 0s 22us/step
Epoch 1/13
20000/20000 [==============================] - 0s 11us/step - loss: 0.6924 - accuracy: 0.5640
Epoch 2/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6559 - accuracy: 0.6346
Epoch 3/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6345 - accuracy: 0.6645
Epoch 4/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6226 - accuracy: 0.6754
Epoch 5/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6160 - accuracy: 0.6784
Epoch 6/13
20000/20000 [==============================] - 0s 6us/step - loss: 0.6120 - accuracy: 0.6803
Epoch 7/13
20000/20000 [==============================] - 0s 6us/step - loss: 0.6094 - accuracy: 0.6810
Epoch 8/13
20000/20000 [==============================] - 0s 6us/step - loss: 0.6076 - accuracy: 0.6815
Epoch 9/13
20000/20000 [==============================] - 0s 6us/step - loss: 0.6061 - accuracy: 0.6817
Epoch 10/13
20000/20000 [==============================] - 0s 6us/step - loss: 0.6048 - accuracy: 0.6823
Epoch 11/13
20000/20000 [==============================] - 0s 8us/step - loss: 0.6038 - accuracy: 0.6829
Epoch 12/13
20000/20000 [==============================] - 0s 8us/step - loss: 0.6029 - accuracy: 0.6836
Epoch 13/13
20000/20000 [==============================] - 0s 7us/step - loss: 0.6022 - accuracy: 0.6843
5697/5697 [==============================] - 0s 24us/step
Epoch 1/14
20000/20000 [==============================] - 0s 15us/step - loss: 0.6958 - accuracy: 0.5697
Epoch 2/14
20000/20000 [==============================] - 0s 7us/step - loss: 0.6597 - accuracy: 0.6404
Epoch 3/14
20000/20000 [==============================] - 0s 7us/step - loss: 0.6423 - accuracy: 0.6642
Epoch 4/14
20000/20000 [==============================] - 0s 7us/step - loss: 0.6303 - accuracy: 0.6748
Epoch 5/14
20000/20000 [==============================] - 0s 8us/step - loss: 0.6224 - accuracy: 0.6778
Epoch 6/14
20000/20000 [==============================] - 0s 6us/step - loss: 0.6170 - accuracy: 0.6799
Epoch 7/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6130 - accuracy: 0.6805
Epoch 8/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6104 - accuracy: 0.6808
Epoch 9/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6083 - accuracy: 0.6816
Epoch 10/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6070 - accuracy: 0.6820
Epoch 11/14
20000/20000 [==============================] - 0s 8us/step - loss: 0.6060 - accuracy: 0.6818
Epoch 12/14
20000/20000 [==============================] - 0s 6us/step - loss: 0.6048 - accuracy: 0.6823
Epoch 13/14
20000/20000 [==============================] - 0s 7us/step - loss: 0.6041 - accuracy: 0.6831
Epoch 14/14
20000/20000 [==============================] - 0s 7us/step - loss: 0.6030 - accuracy: 0.6829
5697/5697 [==============================] - 0s 26us/step
Epoch 1/15
20000/20000 [==============================] - 0s 15us/step - loss: 0.7547 - accuracy: 0.5691
Epoch 2/15
20000/20000 [==============================] - 0s 6us/step - loss: 0.6725 - accuracy: 0.6120
Epoch 3/15
20000/20000 [==============================] - 0s 7us/step - loss: 0.6458 - accuracy: 0.6629
Epoch 4/15
20000/20000 [==============================] - 0s 8us/step - loss: 0.6303 - accuracy: 0.6754
Epoch 5/15
20000/20000 [==============================] - 0s 9us/step - loss: 0.6208 - accuracy: 0.6787
Epoch 6/15
20000/20000 [==============================] - 0s 9us/step - loss: 0.6152 - accuracy: 0.6811
Epoch 7/15
20000/20000 [==============================] - 0s 6us/step - loss: 0.6115 - accuracy: 0.6812
Epoch 8/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6088 - accuracy: 0.6819
Epoch 9/15
20000/20000 [==============================] - 0s 6us/step - loss: 0.6071 - accuracy: 0.6822
Epoch 10/15
20000/20000 [==============================] - 0s 7us/step - loss: 0.6056 - accuracy: 0.6830
Epoch 11/15
20000/20000 [==============================] - 0s 7us/step - loss: 0.6047 - accuracy: 0.6829
Epoch 12/15
20000/20000 [==============================] - 0s 7us/step - loss: 0.6038 - accuracy: 0.6834
Epoch 13/15
20000/20000 [==============================] - 0s 7us/step - loss: 0.6029 - accuracy: 0.6839
Epoch 14/15
20000/20000 [==============================] - 0s 6us/step - loss: 0.6023 - accuracy: 0.6842
Epoch 15/15
20000/20000 [==============================] - 0s 8us/step - loss: 0.6016 - accuracy: 0.6841
5697/5697 [==============================] - 0s 27us/step
Epoch 1/16
20000/20000 [==============================] - 0s 11us/step - loss: 0.6910 - accuracy: 0.5682
Epoch 2/16
20000/20000 [==============================] - 0s 6us/step - loss: 0.6557 - accuracy: 0.6455
Epoch 3/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6371 - accuracy: 0.6643
Epoch 4/16
20000/20000 [==============================] - 0s 6us/step - loss: 0.6252 - accuracy: 0.6760
Epoch 5/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6179 - accuracy: 0.6788
Epoch 6/16
20000/20000 [==============================] - 0s 6us/step - loss: 0.6131 - accuracy: 0.6808
Epoch 7/16
20000/20000 [==============================] - 0s 6us/step - loss: 0.6100 - accuracy: 0.6823
Epoch 8/16
20000/20000 [==============================] - 0s 6us/step - loss: 0.6077 - accuracy: 0.6826
Epoch 9/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6061 - accuracy: 0.6822
Epoch 10/16
20000/20000 [==============================] - 0s 6us/step - loss: 0.6047 - accuracy: 0.6824
Epoch 11/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6038 - accuracy: 0.6834
Epoch 12/16
20000/20000 [==============================] - 0s 6us/step - loss: 0.6030 - accuracy: 0.6834
Epoch 13/16
20000/20000 [==============================] - 0s 6us/step - loss: 0.6021 - accuracy: 0.6839
Epoch 14/16
20000/20000 [==============================] - 0s 6us/step - loss: 0.6017 - accuracy: 0.6841
Epoch 15/16
20000/20000 [==============================] - 0s 6us/step - loss: 0.6011 - accuracy: 0.6848
Epoch 16/16
20000/20000 [==============================] - 0s 6us/step - loss: 0.6007 - accuracy: 0.6842
5697/5697 [==============================] - 0s 20us/step
Epoch 1/17
20000/20000 [==============================] - 0s 17us/step - loss: 0.6883 - accuracy: 0.5833
Epoch 2/17
20000/20000 [==============================] - 0s 8us/step - loss: 0.6557 - accuracy: 0.6471
Epoch 3/17
20000/20000 [==============================] - 0s 7us/step - loss: 0.6382 - accuracy: 0.6683
Epoch 4/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6263 - accuracy: 0.6780
Epoch 5/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6186 - accuracy: 0.6806
Epoch 6/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6137 - accuracy: 0.6805
Epoch 7/17
20000/20000 [==============================] - 0s 4us/step - loss: 0.6103 - accuracy: 0.6815
Epoch 8/17
20000/20000 [==============================] - 0s 8us/step - loss: 0.6082 - accuracy: 0.6816
Epoch 9/17
20000/20000 [==============================] - 0s 7us/step - loss: 0.6066 - accuracy: 0.6823
Epoch 10/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6053 - accuracy: 0.6819
Epoch 11/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6041 - accuracy: 0.6827
Epoch 12/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6033 - accuracy: 0.6828
Epoch 13/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6025 - accuracy: 0.6829
Epoch 14/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6017 - accuracy: 0.6827
Epoch 15/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6012 - accuracy: 0.6830
Epoch 16/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6006 - accuracy: 0.6831
Epoch 17/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6003 - accuracy: 0.6837
5697/5697 [==============================] - 0s 43us/step
Epoch 1/18
20000/20000 [==============================] - 0s 11us/step - loss: 0.6883 - accuracy: 0.5717
Epoch 2/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6541 - accuracy: 0.6384
Epoch 3/18
20000/20000 [==============================] - 0s 7us/step - loss: 0.6351 - accuracy: 0.6638
Epoch 4/18
20000/20000 [==============================] - 0s 7us/step - loss: 0.6235 - accuracy: 0.6711
Epoch 5/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.6163 - accuracy: 0.6786
Epoch 6/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.6115 - accuracy: 0.6809
Epoch 7/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6084 - accuracy: 0.6821
Epoch 8/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6065 - accuracy: 0.6820
Epoch 9/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.6049 - accuracy: 0.6828
Epoch 10/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.6038 - accuracy: 0.6823
Epoch 11/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.6029 - accuracy: 0.6829
Epoch 12/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.6019 - accuracy: 0.6827
Epoch 13/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.6012 - accuracy: 0.6833
Epoch 14/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.6005 - accuracy: 0.6833
Epoch 15/18
20000/20000 [==============================] - 0s 7us/step - loss: 0.6000 - accuracy: 0.6835
Epoch 16/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.5995 - accuracy: 0.6825
Epoch 17/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.5990 - accuracy: 0.6834
Epoch 18/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.5986 - accuracy: 0.6833
5697/5697 [==============================] - 0s 24us/step
Epoch 1/19
20000/20000 [==============================] - 0s 11us/step - loss: 0.7621 - accuracy: 0.5662
Epoch 2/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6728 - accuracy: 0.6225
Epoch 3/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6468 - accuracy: 0.6543
Epoch 4/19
20000/20000 [==============================] - 0s 10us/step - loss: 0.6330 - accuracy: 0.6676
Epoch 5/19
20000/20000 [==============================] - 0s 6us/step - loss: 0.6244 - accuracy: 0.6753
Epoch 6/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6187 - accuracy: 0.6785
Epoch 7/19
20000/20000 [==============================] - 0s 4us/step - loss: 0.6149 - accuracy: 0.6794
Epoch 8/19
20000/20000 [==============================] - 0s 7us/step - loss: 0.6118 - accuracy: 0.6802
Epoch 9/19
20000/20000 [==============================] - 0s 9us/step - loss: 0.6096 - accuracy: 0.6823
Epoch 10/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6076 - accuracy: 0.6827
Epoch 11/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6062 - accuracy: 0.6829
Epoch 12/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6050 - accuracy: 0.6833
Epoch 13/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6041 - accuracy: 0.6832
Epoch 14/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6032 - accuracy: 0.6835
Epoch 15/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6023 - accuracy: 0.6845
Epoch 16/19
20000/20000 [==============================] - 0s 8us/step - loss: 0.6014 - accuracy: 0.6855
Epoch 17/19
20000/20000 [==============================] - 0s 11us/step - loss: 0.6010 - accuracy: 0.6844
Epoch 18/19
20000/20000 [==============================] - 0s 9us/step - loss: 0.6005 - accuracy: 0.6853
Epoch 19/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6002 - accuracy: 0.6854
5697/5697 [==============================] - 0s 19us/step
Epoch 1/20
20000/20000 [==============================] - 0s 11us/step - loss: 0.6994 - accuracy: 0.5901
Epoch 2/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6574 - accuracy: 0.6462
Epoch 3/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6367 - accuracy: 0.6712
Epoch 4/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6246 - accuracy: 0.6791
Epoch 5/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6178 - accuracy: 0.6809
Epoch 6/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6137 - accuracy: 0.6816
Epoch 7/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6108 - accuracy: 0.6826
Epoch 8/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6089 - accuracy: 0.6824
Epoch 9/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6075 - accuracy: 0.6827
Epoch 10/20
20000/20000 [==============================] - 0s 6us/step - loss: 0.6063 - accuracy: 0.6826
Epoch 11/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6056 - accuracy: 0.6833
Epoch 12/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6047 - accuracy: 0.6834
Epoch 13/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6040 - accuracy: 0.6835
Epoch 14/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6034 - accuracy: 0.6832
Epoch 15/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6028 - accuracy: 0.6839
Epoch 16/20
20000/20000 [==============================] - 0s 4us/step - loss: 0.6024 - accuracy: 0.6840
Epoch 17/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6018 - accuracy: 0.6845
Epoch 18/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6014 - accuracy: 0.6841
Epoch 19/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6011 - accuracy: 0.6841
Epoch 20/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6006 - accuracy: 0.6845
5697/5697 [==============================] - 0s 17us/step
Epoch 1/21
20000/20000 [==============================] - 0s 11us/step - loss: 0.6851 - accuracy: 0.5669
Epoch 2/21
20000/20000 [==============================] - 0s 6us/step - loss: 0.6478 - accuracy: 0.6540
Epoch 3/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6316 - accuracy: 0.6701
Epoch 4/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6222 - accuracy: 0.6757
Epoch 5/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6165 - accuracy: 0.6787
Epoch 6/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6128 - accuracy: 0.6812
Epoch 7/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6103 - accuracy: 0.6819
Epoch 8/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6083 - accuracy: 0.6819
Epoch 9/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6068 - accuracy: 0.6823
Epoch 10/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6057 - accuracy: 0.6830
Epoch 11/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6045 - accuracy: 0.6833
Epoch 12/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6038 - accuracy: 0.6830
Epoch 13/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6030 - accuracy: 0.6834
Epoch 14/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6023 - accuracy: 0.6838
Epoch 15/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6019 - accuracy: 0.6841
Epoch 16/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6014 - accuracy: 0.6841
Epoch 17/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6009 - accuracy: 0.6834
Epoch 18/21
20000/20000 [==============================] - 0s 4us/step - loss: 0.6002 - accuracy: 0.6842
Epoch 19/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6002 - accuracy: 0.6841
Epoch 20/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5997 - accuracy: 0.6844
Epoch 21/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5992 - accuracy: 0.6850
5697/5697 [==============================] - 0s 18us/step
Epoch 1/22
20000/20000 [==============================] - 0s 10us/step - loss: 0.7106 - accuracy: 0.5569
Epoch 2/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6491 - accuracy: 0.6503
Epoch 3/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6301 - accuracy: 0.6706
Epoch 4/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6210 - accuracy: 0.6758
Epoch 5/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6159 - accuracy: 0.6781
Epoch 6/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6124 - accuracy: 0.6809
Epoch 7/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6102 - accuracy: 0.6807
Epoch 8/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6084 - accuracy: 0.6815
Epoch 9/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6071 - accuracy: 0.6823
Epoch 10/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6060 - accuracy: 0.6842
Epoch 11/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6053 - accuracy: 0.6834
Epoch 12/22
20000/20000 [==============================] - 0s 4us/step - loss: 0.6045 - accuracy: 0.6839
Epoch 13/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6038 - accuracy: 0.6841
Epoch 14/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6032 - accuracy: 0.6844
Epoch 15/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6025 - accuracy: 0.6848
Epoch 16/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6021 - accuracy: 0.6842
Epoch 17/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6016 - accuracy: 0.6848
Epoch 18/22
20000/20000 [==============================] - 0s 4us/step - loss: 0.6013 - accuracy: 0.6841
Epoch 19/22
20000/20000 [==============================] - 0s 4us/step - loss: 0.6008 - accuracy: 0.6855
Epoch 20/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6006 - accuracy: 0.6854
Epoch 21/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6001 - accuracy: 0.6854
Epoch 22/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5998 - accuracy: 0.6858
5697/5697 [==============================] - 0s 18us/step
Epoch 1/23
20000/20000 [==============================] - 0s 10us/step - loss: 0.7003 - accuracy: 0.5940
Epoch 2/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6580 - accuracy: 0.6463
Epoch 3/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6381 - accuracy: 0.6691
Epoch 4/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6259 - accuracy: 0.6769
Epoch 5/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6182 - accuracy: 0.6799
Epoch 6/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6136 - accuracy: 0.6816
Epoch 7/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6108 - accuracy: 0.6821
Epoch 8/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6087 - accuracy: 0.6837
Epoch 9/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6071 - accuracy: 0.6845
Epoch 10/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6059 - accuracy: 0.6842
Epoch 11/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6050 - accuracy: 0.6841
Epoch 12/23
20000/20000 [==============================] - 0s 4us/step - loss: 0.6040 - accuracy: 0.6841
Epoch 13/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6034 - accuracy: 0.6841
Epoch 14/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6028 - accuracy: 0.6851
Epoch 15/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6023 - accuracy: 0.6855
Epoch 16/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6016 - accuracy: 0.6851
Epoch 17/23
20000/20000 [==============================] - 0s 4us/step - loss: 0.6011 - accuracy: 0.6849
Epoch 18/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6007 - accuracy: 0.6852
Epoch 19/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6002 - accuracy: 0.6855
Epoch 20/23
20000/20000 [==============================] - 0s 4us/step - loss: 0.5997 - accuracy: 0.6859
Epoch 21/23
20000/20000 [==============================] - 0s 6us/step - loss: 0.5994 - accuracy: 0.6859
Epoch 22/23
20000/20000 [==============================] - 0s 6us/step - loss: 0.5990 - accuracy: 0.6864
Epoch 23/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5985 - accuracy: 0.6858
5697/5697 [==============================] - 0s 17us/step
Epoch 1/24
20000/20000 [==============================] - 0s 12us/step - loss: 0.6842 - accuracy: 0.5689
Epoch 2/24
20000/20000 [==============================] - 0s 6us/step - loss: 0.6507 - accuracy: 0.6428
Epoch 3/24
20000/20000 [==============================] - 0s 6us/step - loss: 0.6327 - accuracy: 0.6664
Epoch 4/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6225 - accuracy: 0.6735
Epoch 5/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6164 - accuracy: 0.6770
Epoch 6/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6125 - accuracy: 0.6790
Epoch 7/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6099 - accuracy: 0.6798
Epoch 8/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6079 - accuracy: 0.6810
Epoch 9/24
20000/20000 [==============================] - 0s 4us/step - loss: 0.6065 - accuracy: 0.6825
Epoch 10/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6052 - accuracy: 0.6830
Epoch 11/24
20000/20000 [==============================] - 0s 6us/step - loss: 0.6042 - accuracy: 0.6834
Epoch 12/24
20000/20000 [==============================] - 0s 6us/step - loss: 0.6031 - accuracy: 0.6841
Epoch 13/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6023 - accuracy: 0.6845
Epoch 14/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6015 - accuracy: 0.6848
Epoch 15/24
20000/20000 [==============================] - 0s 6us/step - loss: 0.6010 - accuracy: 0.6852
Epoch 16/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6004 - accuracy: 0.6852
Epoch 17/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5999 - accuracy: 0.6852
Epoch 18/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5993 - accuracy: 0.6849
Epoch 19/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5989 - accuracy: 0.6852
Epoch 20/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5984 - accuracy: 0.6853
Epoch 21/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5980 - accuracy: 0.6849
Epoch 22/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5975 - accuracy: 0.6862
Epoch 23/24
20000/20000 [==============================] - 0s 6us/step - loss: 0.5971 - accuracy: 0.6859
Epoch 24/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5968 - accuracy: 0.6866
5697/5697 [==============================] - 0s 17us/step
Epoch 1/25
20000/20000 [==============================] - 0s 11us/step - loss: 0.7169 - accuracy: 0.5313
Epoch 2/25
20000/20000 [==============================] - 0s 7us/step - loss: 0.6608 - accuracy: 0.6209
Epoch 3/25
20000/20000 [==============================] - 0s 7us/step - loss: 0.6408 - accuracy: 0.6586
Epoch 4/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.6279 - accuracy: 0.6730
Epoch 5/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.6197 - accuracy: 0.6791
Epoch 6/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.6146 - accuracy: 0.6806
Epoch 7/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.6112 - accuracy: 0.6819
Epoch 8/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6090 - accuracy: 0.6833
Epoch 9/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6073 - accuracy: 0.6836
Epoch 10/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6058 - accuracy: 0.6840
Epoch 11/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.6048 - accuracy: 0.6848
Epoch 12/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6042 - accuracy: 0.6850
Epoch 13/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6032 - accuracy: 0.6844
Epoch 14/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6024 - accuracy: 0.6852
Epoch 15/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6017 - accuracy: 0.6862
Epoch 16/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6012 - accuracy: 0.6854
Epoch 17/25
20000/20000 [==============================] - 0s 8us/step - loss: 0.6006 - accuracy: 0.6859
Epoch 18/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6002 - accuracy: 0.6865
Epoch 19/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.5995 - accuracy: 0.6854
Epoch 20/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.5991 - accuracy: 0.6859
Epoch 21/25
20000/20000 [==============================] - 0s 7us/step - loss: 0.5987 - accuracy: 0.6861
Epoch 22/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.5984 - accuracy: 0.6865
Epoch 23/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.5978 - accuracy: 0.6863
Epoch 24/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5975 - accuracy: 0.6862
Epoch 25/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5972 - accuracy: 0.6868
5697/5697 [==============================] - 0s 18us/step
Epoch 1/26
20000/20000 [==============================] - 0s 10us/step - loss: 0.6757 - accuracy: 0.5902
Epoch 2/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6375 - accuracy: 0.6611
Epoch 3/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6236 - accuracy: 0.6782
Epoch 4/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6168 - accuracy: 0.6806
Epoch 5/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6128 - accuracy: 0.6809
Epoch 6/26
20000/20000 [==============================] - 0s 6us/step - loss: 0.6100 - accuracy: 0.6819
Epoch 7/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6081 - accuracy: 0.6826
Epoch 8/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6065 - accuracy: 0.6830
Epoch 9/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6052 - accuracy: 0.6830
Epoch 10/26
20000/20000 [==============================] - 0s 4us/step - loss: 0.6041 - accuracy: 0.6841
Epoch 11/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6030 - accuracy: 0.6838
Epoch 12/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6026 - accuracy: 0.6841
Epoch 13/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6018 - accuracy: 0.6847
Epoch 14/26
20000/20000 [==============================] - 0s 4us/step - loss: 0.6011 - accuracy: 0.6847
Epoch 15/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6005 - accuracy: 0.6851
Epoch 16/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6000 - accuracy: 0.6855
Epoch 17/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5995 - accuracy: 0.6859
Epoch 18/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5992 - accuracy: 0.6866
Epoch 19/26
20000/20000 [==============================] - 0s 6us/step - loss: 0.5987 - accuracy: 0.6865
Epoch 20/26
20000/20000 [==============================] - 0s 6us/step - loss: 0.5983 - accuracy: 0.6867
Epoch 21/26
20000/20000 [==============================] - 0s 10us/step - loss: 0.5979 - accuracy: 0.6872
Epoch 22/26
20000/20000 [==============================] - 0s 9us/step - loss: 0.5978 - accuracy: 0.6876
Epoch 23/26
20000/20000 [==============================] - 0s 7us/step - loss: 0.5975 - accuracy: 0.6860: 0s - loss: 0.5952 - accuracy: 0.68
Epoch 24/26
20000/20000 [==============================] - 0s 6us/step - loss: 0.5969 - accuracy: 0.6873
Epoch 25/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5967 - accuracy: 0.6878
Epoch 26/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5963 - accuracy: 0.6872
5697/5697 [==============================] - 0s 19us/step
Epoch 1/27
20000/20000 [==============================] - 0s 12us/step - loss: 0.6981 - accuracy: 0.5663
Epoch 2/27
20000/20000 [==============================] - 0s 6us/step - loss: 0.6529 - accuracy: 0.6453
Epoch 3/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6341 - accuracy: 0.6662
Epoch 4/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6241 - accuracy: 0.6744
Epoch 5/27
20000/20000 [==============================] - 0s 10us/step - loss: 0.6179 - accuracy: 0.6765
Epoch 6/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6137 - accuracy: 0.6786
Epoch 7/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6106 - accuracy: 0.6801
Epoch 8/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6082 - accuracy: 0.6816
Epoch 9/27
20000/20000 [==============================] - 0s 6us/step - loss: 0.6065 - accuracy: 0.6827
Epoch 10/27
20000/20000 [==============================] - 0s 7us/step - loss: 0.6051 - accuracy: 0.6826
Epoch 11/27
20000/20000 [==============================] - 0s 8us/step - loss: 0.6039 - accuracy: 0.6830
Epoch 12/27
20000/20000 [==============================] - 0s 4us/step - loss: 0.6031 - accuracy: 0.6831
Epoch 13/27
20000/20000 [==============================] - 0s 4us/step - loss: 0.6023 - accuracy: 0.6837
Epoch 14/27
20000/20000 [==============================] - 0s 4us/step - loss: 0.6019 - accuracy: 0.6844
Epoch 15/27
20000/20000 [==============================] - 0s 4us/step - loss: 0.6011 - accuracy: 0.6840
Epoch 16/27
20000/20000 [==============================] - 0s 4us/step - loss: 0.6008 - accuracy: 0.6840
Epoch 17/27
20000/20000 [==============================] - ETA: 0s - loss: 0.6000 - accuracy: 0.68 - 0s 5us/step - loss: 0.6001 - accuracy: 0.6845
Epoch 18/27
20000/20000 [==============================] - 0s 4us/step - loss: 0.5999 - accuracy: 0.6847
Epoch 19/27
20000/20000 [==============================] - 0s 4us/step - loss: 0.5995 - accuracy: 0.6853
Epoch 20/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5989 - accuracy: 0.6849
Epoch 21/27
20000/20000 [==============================] - 0s 4us/step - loss: 0.5987 - accuracy: 0.6847
Epoch 22/27
20000/20000 [==============================] - 0s 4us/step - loss: 0.5985 - accuracy: 0.6845
Epoch 23/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5981 - accuracy: 0.6847
Epoch 24/27
20000/20000 [==============================] - 0s 4us/step - loss: 0.5974 - accuracy: 0.6860
Epoch 25/27
20000/20000 [==============================] - 0s 4us/step - loss: 0.5974 - accuracy: 0.6852
Epoch 26/27
20000/20000 [==============================] - 0s 4us/step - loss: 0.5971 - accuracy: 0.6848
Epoch 27/27
20000/20000 [==============================] - 0s 4us/step - loss: 0.5967 - accuracy: 0.6859
5697/5697 [==============================] - 0s 18us/step
Epoch 1/28
20000/20000 [==============================] - 0s 18us/step - loss: 0.7596 - accuracy: 0.4882
Epoch 2/28
20000/20000 [==============================] - 0s 13us/step - loss: 0.6701 - accuracy: 0.6168
Epoch 3/28
20000/20000 [==============================] - 0s 7us/step - loss: 0.6457 - accuracy: 0.6550
Epoch 4/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6317 - accuracy: 0.6711
Epoch 5/28
20000/20000 [==============================] - 0s 4us/step - loss: 0.6230 - accuracy: 0.6759
Epoch 6/28
20000/20000 [==============================] - 0s 4us/step - loss: 0.6172 - accuracy: 0.6787
Epoch 7/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6133 - accuracy: 0.6794
Epoch 8/28
20000/20000 [==============================] - 0s 4us/step - loss: 0.6105 - accuracy: 0.6804
Epoch 9/28
20000/20000 [==============================] - 0s 4us/step - loss: 0.6085 - accuracy: 0.6809
Epoch 10/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6069 - accuracy: 0.6812
Epoch 11/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6058 - accuracy: 0.6819
Epoch 12/28
20000/20000 [==============================] - 0s 4us/step - loss: 0.6048 - accuracy: 0.6830
Epoch 13/28
20000/20000 [==============================] - 0s 4us/step - loss: 0.6038 - accuracy: 0.6829
Epoch 14/28
20000/20000 [==============================] - 0s 4us/step - loss: 0.6030 - accuracy: 0.6835
Epoch 15/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6024 - accuracy: 0.6841
Epoch 16/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6017 - accuracy: 0.6838
Epoch 17/28
20000/20000 [==============================] - 0s 4us/step - loss: 0.6012 - accuracy: 0.6838
Epoch 18/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6006 - accuracy: 0.6847
Epoch 19/28
20000/20000 [==============================] - 0s 4us/step - loss: 0.6000 - accuracy: 0.6849
Epoch 20/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5997 - accuracy: 0.6848
Epoch 21/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5993 - accuracy: 0.6849
Epoch 22/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5991 - accuracy: 0.6858
Epoch 23/28
20000/20000 [==============================] - 0s 4us/step - loss: 0.5985 - accuracy: 0.6847
Epoch 24/28
20000/20000 [==============================] - 0s 4us/step - loss: 0.5982 - accuracy: 0.6847
Epoch 25/28
20000/20000 [==============================] - 0s 4us/step - loss: 0.5976 - accuracy: 0.6859
Epoch 26/28
20000/20000 [==============================] - 0s 4us/step - loss: 0.5974 - accuracy: 0.6865
Epoch 27/28
20000/20000 [==============================] - 0s 4us/step - loss: 0.5972 - accuracy: 0.6860
Epoch 28/28
20000/20000 [==============================] - 0s 4us/step - loss: 0.5968 - accuracy: 0.6862
5697/5697 [==============================] - 0s 18us/step
Epoch 1/29
20000/20000 [==============================] - 0s 10us/step - loss: 0.6921 - accuracy: 0.5644
Epoch 2/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6485 - accuracy: 0.6451
Epoch 3/29
20000/20000 [==============================] - 0s 4us/step - loss: 0.6322 - accuracy: 0.6624
Epoch 4/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6228 - accuracy: 0.6712
Epoch 5/29
20000/20000 [==============================] - 0s 4us/step - loss: 0.6168 - accuracy: 0.6750
Epoch 6/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6130 - accuracy: 0.6769
Epoch 7/29
20000/20000 [==============================] - 0s 4us/step - loss: 0.6101 - accuracy: 0.6784
Epoch 8/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6080 - accuracy: 0.6784
Epoch 9/29
20000/20000 [==============================] - 0s 4us/step - loss: 0.6064 - accuracy: 0.6793
Epoch 10/29
20000/20000 [==============================] - 0s 4us/step - loss: 0.6052 - accuracy: 0.6794
Epoch 11/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6043 - accuracy: 0.6791
Epoch 12/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6035 - accuracy: 0.6801
Epoch 13/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6025 - accuracy: 0.6800
Epoch 14/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6020 - accuracy: 0.6803
Epoch 15/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6014 - accuracy: 0.6809
Epoch 16/29
20000/20000 [==============================] - 0s 4us/step - loss: 0.6007 - accuracy: 0.6804
Epoch 17/29
20000/20000 [==============================] - 0s 4us/step - loss: 0.6002 - accuracy: 0.6815
Epoch 18/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5997 - accuracy: 0.6814
Epoch 19/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.5993 - accuracy: 0.6833
Epoch 20/29
20000/20000 [==============================] - 0s 4us/step - loss: 0.5988 - accuracy: 0.6826
Epoch 21/29
20000/20000 [==============================] - 0s 4us/step - loss: 0.5983 - accuracy: 0.6828
Epoch 22/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5979 - accuracy: 0.6841
Epoch 23/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.5977 - accuracy: 0.6837
Epoch 24/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.5972 - accuracy: 0.6844
Epoch 25/29
20000/20000 [==============================] - 0s 4us/step - loss: 0.5969 - accuracy: 0.6836
Epoch 26/29
20000/20000 [==============================] - 0s 4us/step - loss: 0.5966 - accuracy: 0.6844
Epoch 27/29
20000/20000 [==============================] - 0s 4us/step - loss: 0.5963 - accuracy: 0.6843
Epoch 28/29
20000/20000 [==============================] - 0s 4us/step - loss: 0.5959 - accuracy: 0.6844
Epoch 29/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5956 - accuracy: 0.6845
5697/5697 [==============================] - 0s 19us/step
Epoch 1/30
20000/20000 [==============================] - 0s 10us/step - loss: 0.6932 - accuracy: 0.5713
Epoch 2/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6460 - accuracy: 0.6529
Epoch 3/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6276 - accuracy: 0.6744
Epoch 4/30
20000/20000 [==============================] - 0s 4us/step - loss: 0.6186 - accuracy: 0.6798
Epoch 5/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6139 - accuracy: 0.6809
Epoch 6/30
20000/20000 [==============================] - 0s 4us/step - loss: 0.6109 - accuracy: 0.6816
Epoch 7/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6090 - accuracy: 0.6816
Epoch 8/30
20000/20000 [==============================] - 0s 4us/step - loss: 0.6074 - accuracy: 0.6820
Epoch 9/30
20000/20000 [==============================] - 0s 4us/step - loss: 0.6062 - accuracy: 0.6833
Epoch 10/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6052 - accuracy: 0.6825
Epoch 11/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6044 - accuracy: 0.6830
Epoch 12/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6036 - accuracy: 0.6836
Epoch 13/30
20000/20000 [==============================] - 0s 4us/step - loss: 0.6029 - accuracy: 0.6841
Epoch 14/30
20000/20000 [==============================] - 0s 4us/step - loss: 0.6024 - accuracy: 0.6841
Epoch 15/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.6019 - accuracy: 0.6846
Epoch 16/30
20000/20000 [==============================] - 0s 4us/step - loss: 0.6014 - accuracy: 0.6843
Epoch 17/30
20000/20000 [==============================] - 0s 4us/step - loss: 0.6009 - accuracy: 0.6848
Epoch 18/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6004 - accuracy: 0.6846
Epoch 19/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6000 - accuracy: 0.6842
Epoch 20/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5997 - accuracy: 0.6844
Epoch 21/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5994 - accuracy: 0.6852
Epoch 22/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5988 - accuracy: 0.6852
Epoch 23/30
20000/20000 [==============================] - 0s 7us/step - loss: 0.5986 - accuracy: 0.6844
Epoch 24/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5983 - accuracy: 0.6850
Epoch 25/30
20000/20000 [==============================] - 0s 4us/step - loss: 0.5980 - accuracy: 0.6849
Epoch 26/30
20000/20000 [==============================] - 0s 4us/step - loss: 0.5977 - accuracy: 0.6857
Epoch 27/30
20000/20000 [==============================] - 0s 4us/step - loss: 0.5975 - accuracy: 0.6855
Epoch 28/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5972 - accuracy: 0.6855
Epoch 29/30
20000/20000 [==============================] - 0s 4us/step - loss: 0.5969 - accuracy: 0.6851
Epoch 30/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5967 - accuracy: 0.6858
5697/5697 [==============================] - 0s 19us/step
Epoch 1/7
20000/20000 [==============================] - 0s 10us/step - loss: 0.6788 - accuracy: 0.5900
Epoch 2/7
20000/20000 [==============================] - 0s 5us/step - loss: 0.6450 - accuracy: 0.6568
Epoch 3/7
20000/20000 [==============================] - 0s 5us/step - loss: 0.6290 - accuracy: 0.6736
Epoch 4/7
20000/20000 [==============================] - 0s 5us/step - loss: 0.6203 - accuracy: 0.6784
Epoch 5/7
20000/20000 [==============================] - 0s 5us/step - loss: 0.6150 - accuracy: 0.6811
Epoch 6/7
20000/20000 [==============================] - 0s 5us/step - loss: 0.6113 - accuracy: 0.6819
Epoch 7/7
20000/20000 [==============================] - 0s 5us/step - loss: 0.6087 - accuracy: 0.6831
5697/5697 [==============================] - 0s 26us/step
Epoch 1/8
20000/20000 [==============================] - 0s 11us/step - loss: 0.6785 - accuracy: 0.5888
Epoch 2/8
20000/20000 [==============================] - 0s 5us/step - loss: 0.6393 - accuracy: 0.6563
Epoch 3/8
20000/20000 [==============================] - 0s 8us/step - loss: 0.6231 - accuracy: 0.6789
Epoch 4/8
20000/20000 [==============================] - 0s 4us/step - loss: 0.6158 - accuracy: 0.6807
Epoch 5/8
20000/20000 [==============================] - 0s 6us/step - loss: 0.6117 - accuracy: 0.6811
Epoch 6/8
20000/20000 [==============================] - 0s 7us/step - loss: 0.6090 - accuracy: 0.6823
Epoch 7/8
20000/20000 [==============================] - 0s 7us/step - loss: 0.6072 - accuracy: 0.6824
Epoch 8/8
20000/20000 [==============================] - 0s 5us/step - loss: 0.6057 - accuracy: 0.6826
5697/5697 [==============================] - 0s 21us/step
Epoch 1/9
20000/20000 [==============================] - 0s 10us/step - loss: 0.6776 - accuracy: 0.6005
Epoch 2/9
20000/20000 [==============================] - 0s 4us/step - loss: 0.6421 - accuracy: 0.6585
Epoch 3/9
20000/20000 [==============================] - 0s 4us/step - loss: 0.6274 - accuracy: 0.6769
Epoch 4/9
20000/20000 [==============================] - 0s 4us/step - loss: 0.6189 - accuracy: 0.6793
Epoch 5/9
20000/20000 [==============================] - 0s 5us/step - loss: 0.6141 - accuracy: 0.6808
Epoch 6/9
20000/20000 [==============================] - 0s 7us/step - loss: 0.6111 - accuracy: 0.6826
Epoch 7/9
20000/20000 [==============================] - 0s 5us/step - loss: 0.6085 - accuracy: 0.6823
Epoch 8/9
20000/20000 [==============================] - 0s 5us/step - loss: 0.6069 - accuracy: 0.6841
Epoch 9/9
20000/20000 [==============================] - 0s 5us/step - loss: 0.6058 - accuracy: 0.6837
5697/5697 [==============================] - 0s 18us/step
Epoch 1/10
20000/20000 [==============================] - 0s 10us/step - loss: 0.7329 - accuracy: 0.5254
Epoch 2/10
20000/20000 [==============================] - 0s 4us/step - loss: 0.6455 - accuracy: 0.6632
Epoch 3/10
20000/20000 [==============================] - 0s 4us/step - loss: 0.6292 - accuracy: 0.6755
Epoch 4/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.6206 - accuracy: 0.6780
Epoch 5/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.6155 - accuracy: 0.6794
Epoch 6/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.6123 - accuracy: 0.6805
Epoch 7/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.6100 - accuracy: 0.6811
Epoch 8/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.6083 - accuracy: 0.6816
Epoch 9/10
20000/20000 [==============================] - 0s 4us/step - loss: 0.6073 - accuracy: 0.6819
Epoch 10/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.6059 - accuracy: 0.6820
5697/5697 [==============================] - 0s 20us/step
Epoch 1/11
20000/20000 [==============================] - 0s 11us/step - loss: 0.7073 - accuracy: 0.5587
Epoch 2/11
20000/20000 [==============================] - 0s 6us/step - loss: 0.6540 - accuracy: 0.6416
Epoch 3/11
20000/20000 [==============================] - 0s 6us/step - loss: 0.6345 - accuracy: 0.6658
Epoch 4/11
20000/20000 [==============================] - 0s 6us/step - loss: 0.6237 - accuracy: 0.6740
Epoch 5/11
20000/20000 [==============================] - 0s 5us/step - loss: 0.6170 - accuracy: 0.6783
Epoch 6/11
20000/20000 [==============================] - 0s 4us/step - loss: 0.6127 - accuracy: 0.6801
Epoch 7/11
20000/20000 [==============================] - 0s 4us/step - loss: 0.6099 - accuracy: 0.6817
Epoch 8/11
20000/20000 [==============================] - 0s 5us/step - loss: 0.6078 - accuracy: 0.6825
Epoch 9/11
20000/20000 [==============================] - 0s 5us/step - loss: 0.6064 - accuracy: 0.6831
Epoch 10/11
20000/20000 [==============================] - 0s 5us/step - loss: 0.6051 - accuracy: 0.6828
Epoch 11/11
20000/20000 [==============================] - 0s 7us/step - loss: 0.6042 - accuracy: 0.6841
5697/5697 [==============================] - 0s 18us/step
Epoch 1/12
20000/20000 [==============================] - 0s 10us/step - loss: 0.6725 - accuracy: 0.5962
Epoch 2/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6411 - accuracy: 0.6571
Epoch 3/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6267 - accuracy: 0.6690
Epoch 4/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6187 - accuracy: 0.6755
Epoch 5/12
20000/20000 [==============================] - 0s 6us/step - loss: 0.6136 - accuracy: 0.6783
Epoch 6/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6106 - accuracy: 0.6809
Epoch 7/12
20000/20000 [==============================] - 0s 4us/step - loss: 0.6083 - accuracy: 0.6817
Epoch 8/12
20000/20000 [==============================] - 0s 4us/step - loss: 0.6065 - accuracy: 0.6823
Epoch 9/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6054 - accuracy: 0.6828
Epoch 10/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6044 - accuracy: 0.6829
Epoch 11/12
20000/20000 [==============================] - 0s 4us/step - loss: 0.6037 - accuracy: 0.6834
Epoch 12/12
20000/20000 [==============================] - 0s 4us/step - loss: 0.6028 - accuracy: 0.6830
5697/5697 [==============================] - 0s 18us/step
Epoch 1/13
20000/20000 [==============================] - 0s 10us/step - loss: 0.7007 - accuracy: 0.5699
Epoch 2/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6529 - accuracy: 0.6404
Epoch 3/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6321 - accuracy: 0.6672
Epoch 4/13
20000/20000 [==============================] - 0s 4us/step - loss: 0.6219 - accuracy: 0.6753
Epoch 5/13
20000/20000 [==============================] - 0s 4us/step - loss: 0.6161 - accuracy: 0.6798
Epoch 6/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6126 - accuracy: 0.6809
Epoch 7/13
20000/20000 [==============================] - 0s 4us/step - loss: 0.6105 - accuracy: 0.6823
Epoch 8/13
20000/20000 [==============================] - 0s 4us/step - loss: 0.6085 - accuracy: 0.6831
Epoch 9/13
20000/20000 [==============================] - 0s 4us/step - loss: 0.6072 - accuracy: 0.6823
Epoch 10/13
20000/20000 [==============================] - 0s 4us/step - loss: 0.6060 - accuracy: 0.6837
Epoch 11/13
20000/20000 [==============================] - 0s 4us/step - loss: 0.6050 - accuracy: 0.6829
Epoch 12/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6042 - accuracy: 0.6828
Epoch 13/13
20000/20000 [==============================] - 0s 4us/step - loss: 0.6035 - accuracy: 0.6831
5697/5697 [==============================] - 0s 19us/step
Epoch 1/14
20000/20000 [==============================] - 0s 12us/step - loss: 0.6765 - accuracy: 0.5878
Epoch 2/14
20000/20000 [==============================] - 0s 4us/step - loss: 0.6449 - accuracy: 0.6626
Epoch 3/14
20000/20000 [==============================] - 0s 4us/step - loss: 0.6291 - accuracy: 0.6761
Epoch 4/14
20000/20000 [==============================] - 0s 4us/step - loss: 0.6206 - accuracy: 0.6805
Epoch 5/14
20000/20000 [==============================] - 0s 4us/step - loss: 0.6155 - accuracy: 0.6823
Epoch 6/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6122 - accuracy: 0.6824
Epoch 7/14
20000/20000 [==============================] - 0s 4us/step - loss: 0.6097 - accuracy: 0.6830
Epoch 8/14
20000/20000 [==============================] - 0s 4us/step - loss: 0.6081 - accuracy: 0.6831
Epoch 9/14
20000/20000 [==============================] - 0s 6us/step - loss: 0.6065 - accuracy: 0.6833
Epoch 10/14
20000/20000 [==============================] - 0s 4us/step - loss: 0.6054 - accuracy: 0.6824
Epoch 11/14
20000/20000 [==============================] - 0s 4us/step - loss: 0.6046 - accuracy: 0.6827
Epoch 12/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6038 - accuracy: 0.6836
Epoch 13/14
20000/20000 [==============================] - 0s 4us/step - loss: 0.6033 - accuracy: 0.6831
Epoch 14/14
20000/20000 [==============================] - 0s 4us/step - loss: 0.6026 - accuracy: 0.6832
5697/5697 [==============================] - 0s 21us/step
Epoch 1/15
20000/20000 [==============================] - 0s 11us/step - loss: 0.7091 - accuracy: 0.5304
Epoch 2/15
20000/20000 [==============================] - 0s 6us/step - loss: 0.6603 - accuracy: 0.6319
Epoch 3/15
20000/20000 [==============================] - 0s 4us/step - loss: 0.6362 - accuracy: 0.6654
Epoch 4/15
20000/20000 [==============================] - 0s 4us/step - loss: 0.6241 - accuracy: 0.6748
Epoch 5/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6173 - accuracy: 0.6784
Epoch 6/15
20000/20000 [==============================] - 0s 4us/step - loss: 0.6134 - accuracy: 0.6801
Epoch 7/15
20000/20000 [==============================] - 0s 4us/step - loss: 0.6110 - accuracy: 0.6815
Epoch 8/15
20000/20000 [==============================] - 0s 4us/step - loss: 0.6087 - accuracy: 0.6820
Epoch 9/15
20000/20000 [==============================] - 0s 4us/step - loss: 0.6070 - accuracy: 0.6825
Epoch 10/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6058 - accuracy: 0.6826
Epoch 11/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6046 - accuracy: 0.6823
Epoch 12/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6038 - accuracy: 0.6828
Epoch 13/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6030 - accuracy: 0.6836
Epoch 14/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6024 - accuracy: 0.6837
Epoch 15/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6018 - accuracy: 0.6845
5697/5697 [==============================] - 0s 18us/step
Epoch 1/16
20000/20000 [==============================] - 0s 10us/step - loss: 0.6687 - accuracy: 0.6170
Epoch 2/16
20000/20000 [==============================] - 0s 6us/step - loss: 0.6405 - accuracy: 0.6620
Epoch 3/16
20000/20000 [==============================] - 0s 6us/step - loss: 0.6272 - accuracy: 0.6755
Epoch 4/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6198 - accuracy: 0.6796
Epoch 5/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6151 - accuracy: 0.6807
Epoch 6/16
20000/20000 [==============================] - 0s 4us/step - loss: 0.6118 - accuracy: 0.6823
Epoch 7/16
20000/20000 [==============================] - 0s 4us/step - loss: 0.6100 - accuracy: 0.6827
Epoch 8/16
20000/20000 [==============================] - 0s 4us/step - loss: 0.6081 - accuracy: 0.6830
Epoch 9/16
20000/20000 [==============================] - 0s 4us/step - loss: 0.6068 - accuracy: 0.6828
Epoch 10/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6056 - accuracy: 0.6838
Epoch 11/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6044 - accuracy: 0.6840
Epoch 12/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6037 - accuracy: 0.6838
Epoch 13/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6030 - accuracy: 0.6844
Epoch 14/16
20000/20000 [==============================] - 0s 6us/step - loss: 0.6022 - accuracy: 0.6848
Epoch 15/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6018 - accuracy: 0.6849
Epoch 16/16
20000/20000 [==============================] - 0s 4us/step - loss: 0.6011 - accuracy: 0.6852
5697/5697 [==============================] - 0s 18us/step
Epoch 1/17
20000/20000 [==============================] - 0s 11us/step - loss: 0.6648 - accuracy: 0.6154
Epoch 2/17
20000/20000 [==============================] - 0s 6us/step - loss: 0.6344 - accuracy: 0.6636
Epoch 3/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6213 - accuracy: 0.6771
Epoch 4/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6147 - accuracy: 0.6805
Epoch 5/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6111 - accuracy: 0.6819
Epoch 6/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6086 - accuracy: 0.6820
Epoch 7/17
20000/20000 [==============================] - 0s 4us/step - loss: 0.6071 - accuracy: 0.6820
Epoch 8/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6058 - accuracy: 0.6824
Epoch 9/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6046 - accuracy: 0.6829
Epoch 10/17
20000/20000 [==============================] - 0s 4us/step - loss: 0.6038 - accuracy: 0.6834
Epoch 11/17
20000/20000 [==============================] - 0s 4us/step - loss: 0.6031 - accuracy: 0.6836
Epoch 12/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6021 - accuracy: 0.6840
Epoch 13/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6015 - accuracy: 0.6837
Epoch 14/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6011 - accuracy: 0.6842
Epoch 15/17
20000/20000 [==============================] - 0s 4us/step - loss: 0.6002 - accuracy: 0.6844
Epoch 16/17
20000/20000 [==============================] - 0s 4us/step - loss: 0.5999 - accuracy: 0.6837
Epoch 17/17
20000/20000 [==============================] - 0s 4us/step - loss: 0.5995 - accuracy: 0.6847
5697/5697 [==============================] - 0s 20us/step
Epoch 1/18
20000/20000 [==============================] - 0s 10us/step - loss: 0.6755 - accuracy: 0.5917
Epoch 2/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6425 - accuracy: 0.6640
Epoch 3/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6277 - accuracy: 0.6759
Epoch 4/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.6192 - accuracy: 0.6788
Epoch 5/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6144 - accuracy: 0.6811
Epoch 6/18
20000/20000 [==============================] - 0s 4us/step - loss: 0.6112 - accuracy: 0.6824
Epoch 7/18
20000/20000 [==============================] - 0s 7us/step - loss: 0.6086 - accuracy: 0.6826
Epoch 8/18
20000/20000 [==============================] - 0s 9us/step - loss: 0.6070 - accuracy: 0.6824
Epoch 9/18
20000/20000 [==============================] - 0s 11us/step - loss: 0.6055 - accuracy: 0.6834
Epoch 10/18
20000/20000 [==============================] - 0s 8us/step - loss: 0.6040 - accuracy: 0.6839
Epoch 11/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.6034 - accuracy: 0.6841
Epoch 12/18
20000/20000 [==============================] - 0s 8us/step - loss: 0.6026 - accuracy: 0.6834
Epoch 13/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.6019 - accuracy: 0.6842
Epoch 14/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.6012 - accuracy: 0.6845
Epoch 15/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.6008 - accuracy: 0.6848
Epoch 16/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6001 - accuracy: 0.6844
Epoch 17/18
20000/20000 [==============================] - 0s 8us/step - loss: 0.5997 - accuracy: 0.6844
Epoch 18/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5991 - accuracy: 0.6848
5697/5697 [==============================] - 0s 17us/step
Epoch 1/19
20000/20000 [==============================] - 0s 11us/step - loss: 0.6709 - accuracy: 0.6115
Epoch 2/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6394 - accuracy: 0.6652
Epoch 3/19
20000/20000 [==============================] - 0s 4us/step - loss: 0.6243 - accuracy: 0.6763
Epoch 4/19
20000/20000 [==============================] - 0s 4us/step - loss: 0.6166 - accuracy: 0.6801
Epoch 5/19
20000/20000 [==============================] - 0s 4us/step - loss: 0.6122 - accuracy: 0.6812
Epoch 6/19
20000/20000 [==============================] - 0s 4us/step - loss: 0.6089 - accuracy: 0.6817
Epoch 7/19
20000/20000 [==============================] - 0s 4us/step - loss: 0.6069 - accuracy: 0.6816
Epoch 8/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6054 - accuracy: 0.6816
Epoch 9/19
20000/20000 [==============================] - 0s 4us/step - loss: 0.6044 - accuracy: 0.6816
Epoch 10/19
20000/20000 [==============================] - 0s 4us/step - loss: 0.6037 - accuracy: 0.6830
Epoch 11/19
20000/20000 [==============================] - 0s 4us/step - loss: 0.6029 - accuracy: 0.6831
Epoch 12/19
20000/20000 [==============================] - 0s 6us/step - loss: 0.6021 - accuracy: 0.6833
Epoch 13/19
20000/20000 [==============================] - 0s 6us/step - loss: 0.6016 - accuracy: 0.6837
Epoch 14/19
20000/20000 [==============================] - 0s 4us/step - loss: 0.6013 - accuracy: 0.6841
Epoch 15/19
20000/20000 [==============================] - 0s 4us/step - loss: 0.6008 - accuracy: 0.6841
Epoch 16/19
20000/20000 [==============================] - 0s 4us/step - loss: 0.6002 - accuracy: 0.6840
Epoch 17/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5998 - accuracy: 0.6839
Epoch 18/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5993 - accuracy: 0.6849
Epoch 19/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5990 - accuracy: 0.6839
5697/5697 [==============================] - 0s 18us/step
Epoch 1/20
20000/20000 [==============================] - 0s 10us/step - loss: 0.6939 - accuracy: 0.5748
Epoch 2/20
20000/20000 [==============================] - 0s 4us/step - loss: 0.6547 - accuracy: 0.6312
Epoch 3/20
20000/20000 [==============================] - 0s 4us/step - loss: 0.6361 - accuracy: 0.6582
Epoch 4/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6249 - accuracy: 0.6714
Epoch 5/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6177 - accuracy: 0.6773
Epoch 6/20
20000/20000 [==============================] - 0s 4us/step - loss: 0.6130 - accuracy: 0.6794
Epoch 7/20
20000/20000 [==============================] - 0s 4us/step - loss: 0.6099 - accuracy: 0.6809
Epoch 8/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6075 - accuracy: 0.6805
Epoch 9/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6057 - accuracy: 0.6815
Epoch 10/20
20000/20000 [==============================] - 0s 4us/step - loss: 0.6045 - accuracy: 0.6820
Epoch 11/20
20000/20000 [==============================] - 0s 4us/step - loss: 0.6034 - accuracy: 0.6824
Epoch 12/20
20000/20000 [==============================] - 0s 6us/step - loss: 0.6025 - accuracy: 0.6830
Epoch 13/20
20000/20000 [==============================] - 0s 6us/step - loss: 0.6016 - accuracy: 0.6834
Epoch 14/20
20000/20000 [==============================] - 0s 4us/step - loss: 0.6008 - accuracy: 0.6835
Epoch 15/20
20000/20000 [==============================] - 0s 4us/step - loss: 0.6003 - accuracy: 0.6844
Epoch 16/20
20000/20000 [==============================] - 0s 4us/step - loss: 0.5996 - accuracy: 0.6841
Epoch 17/20
20000/20000 [==============================] - 0s 4us/step - loss: 0.5991 - accuracy: 0.6842
Epoch 18/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5987 - accuracy: 0.6847
Epoch 19/20
20000/20000 [==============================] - 0s 4us/step - loss: 0.5981 - accuracy: 0.6849
Epoch 20/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5976 - accuracy: 0.6852
5697/5697 [==============================] - 0s 19us/step
Epoch 1/21
20000/20000 [==============================] - 0s 10us/step - loss: 0.6830 - accuracy: 0.5809
Epoch 2/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6505 - accuracy: 0.6449
Epoch 3/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6320 - accuracy: 0.6622
Epoch 4/21
20000/20000 [==============================] - 0s 4us/step - loss: 0.6214 - accuracy: 0.6730
Epoch 5/21
20000/20000 [==============================] - 0s 4us/step - loss: 0.6156 - accuracy: 0.6777
Epoch 6/21
20000/20000 [==============================] - 0s 6us/step - loss: 0.6118 - accuracy: 0.6801
Epoch 7/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6091 - accuracy: 0.6815
Epoch 8/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6071 - accuracy: 0.6825
Epoch 9/21
20000/20000 [==============================] - 0s 6us/step - loss: 0.6058 - accuracy: 0.6834
Epoch 10/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6044 - accuracy: 0.6845
Epoch 11/21
20000/20000 [==============================] - 0s 4us/step - loss: 0.6035 - accuracy: 0.6843
Epoch 12/21
20000/20000 [==============================] - 0s 4us/step - loss: 0.6027 - accuracy: 0.6844
Epoch 13/21
20000/20000 [==============================] - 0s 4us/step - loss: 0.6017 - accuracy: 0.6848
Epoch 14/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6011 - accuracy: 0.6849
Epoch 15/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6004 - accuracy: 0.6849
Epoch 16/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5999 - accuracy: 0.6855
Epoch 17/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5992 - accuracy: 0.6856
Epoch 18/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5987 - accuracy: 0.6860
Epoch 19/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5986 - accuracy: 0.6853
Epoch 20/21
20000/20000 [==============================] - 0s 4us/step - loss: 0.5981 - accuracy: 0.6859
Epoch 21/21
20000/20000 [==============================] - 0s 4us/step - loss: 0.5976 - accuracy: 0.6862
5697/5697 [==============================] - 0s 18us/step
Epoch 1/22
20000/20000 [==============================] - 0s 11us/step - loss: 0.7021 - accuracy: 0.5459
Epoch 2/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6560 - accuracy: 0.6262
Epoch 3/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6357 - accuracy: 0.6635
Epoch 4/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6236 - accuracy: 0.6744
Epoch 5/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6166 - accuracy: 0.6784
Epoch 6/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6126 - accuracy: 0.6800
Epoch 7/22
20000/20000 [==============================] - 0s 6us/step - loss: 0.6101 - accuracy: 0.6808
Epoch 8/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6081 - accuracy: 0.6815
Epoch 9/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6062 - accuracy: 0.6820
Epoch 10/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6051 - accuracy: 0.6823
Epoch 11/22
20000/20000 [==============================] - 0s 8us/step - loss: 0.6041 - accuracy: 0.6828
Epoch 12/22
20000/20000 [==============================] - 0s 7us/step - loss: 0.6030 - accuracy: 0.6828
Epoch 13/22
20000/20000 [==============================] - 0s 4us/step - loss: 0.6023 - accuracy: 0.6837
Epoch 14/22
20000/20000 [==============================] - 0s 4us/step - loss: 0.6016 - accuracy: 0.6829
Epoch 15/22
20000/20000 [==============================] - 0s 4us/step - loss: 0.6008 - accuracy: 0.6840
Epoch 16/22
20000/20000 [==============================] - 0s 4us/step - loss: 0.6003 - accuracy: 0.6835
Epoch 17/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5997 - accuracy: 0.6837
Epoch 18/22
20000/20000 [==============================] - 0s 4us/step - loss: 0.5990 - accuracy: 0.6849
Epoch 19/22
20000/20000 [==============================] - 0s 4us/step - loss: 0.5984 - accuracy: 0.6851
Epoch 20/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5981 - accuracy: 0.6842
Epoch 21/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5974 - accuracy: 0.6855
Epoch 22/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5973 - accuracy: 0.6852
5697/5697 [==============================] - 0s 21us/step
Epoch 1/23
20000/20000 [==============================] - 0s 10us/step - loss: 0.7098 - accuracy: 0.5290
Epoch 2/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6557 - accuracy: 0.6428
Epoch 3/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6363 - accuracy: 0.6621
Epoch 4/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6246 - accuracy: 0.6703
Epoch 5/23
20000/20000 [==============================] - 0s 4us/step - loss: 0.6180 - accuracy: 0.6787
Epoch 6/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6139 - accuracy: 0.6826
Epoch 7/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6111 - accuracy: 0.6834
Epoch 8/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6088 - accuracy: 0.6833
Epoch 9/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6074 - accuracy: 0.6831
Epoch 10/23
20000/20000 [==============================] - 0s 4us/step - loss: 0.6061 - accuracy: 0.6834
Epoch 11/23
20000/20000 [==============================] - 0s 4us/step - loss: 0.6050 - accuracy: 0.6833
Epoch 12/23
20000/20000 [==============================] - 0s 4us/step - loss: 0.6042 - accuracy: 0.6843
Epoch 13/23
20000/20000 [==============================] - 0s 4us/step - loss: 0.6032 - accuracy: 0.6844
Epoch 14/23
20000/20000 [==============================] - 0s 4us/step - loss: 0.6028 - accuracy: 0.6837
Epoch 15/23
20000/20000 [==============================] - 0s 4us/step - loss: 0.6021 - accuracy: 0.6841
Epoch 16/23
20000/20000 [==============================] - 0s 4us/step - loss: 0.6017 - accuracy: 0.6834
Epoch 17/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6010 - accuracy: 0.6841
Epoch 18/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6006 - accuracy: 0.6837
Epoch 19/23
20000/20000 [==============================] - 0s 4us/step - loss: 0.6002 - accuracy: 0.6853
Epoch 20/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5997 - accuracy: 0.6847
Epoch 21/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5992 - accuracy: 0.6855
Epoch 22/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5989 - accuracy: 0.6844
Epoch 23/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5986 - accuracy: 0.6846
5697/5697 [==============================] - 0s 17us/step
Epoch 1/24
20000/20000 [==============================] - 0s 11us/step - loss: 0.6859 - accuracy: 0.5657
Epoch 2/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6455 - accuracy: 0.6511
Epoch 3/24
20000/20000 [==============================] - 0s 4us/step - loss: 0.6275 - accuracy: 0.6704
Epoch 4/24
20000/20000 [==============================] - 0s 4us/step - loss: 0.6178 - accuracy: 0.6748
Epoch 5/24
20000/20000 [==============================] - 0s 4us/step - loss: 0.6123 - accuracy: 0.6805
Epoch 6/24
20000/20000 [==============================] - 0s 4us/step - loss: 0.6090 - accuracy: 0.6806
Epoch 7/24
20000/20000 [==============================] - 0s 4us/step - loss: 0.6066 - accuracy: 0.6822
Epoch 8/24
20000/20000 [==============================] - 0s 4us/step - loss: 0.6052 - accuracy: 0.6823
Epoch 9/24
20000/20000 [==============================] - 0s 4us/step - loss: 0.6036 - accuracy: 0.6837
Epoch 10/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6027 - accuracy: 0.6833
Epoch 11/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6016 - accuracy: 0.6830
Epoch 12/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6009 - accuracy: 0.6830
Epoch 13/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6002 - accuracy: 0.6843
Epoch 14/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5996 - accuracy: 0.6839
Epoch 15/24
20000/20000 [==============================] - 0s 4us/step - loss: 0.5991 - accuracy: 0.6844
Epoch 16/24
20000/20000 [==============================] - 0s 4us/step - loss: 0.5982 - accuracy: 0.6840
Epoch 17/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5981 - accuracy: 0.6848
Epoch 18/24
20000/20000 [==============================] - 0s 4us/step - loss: 0.5976 - accuracy: 0.6845
Epoch 19/24
20000/20000 [==============================] - 0s 4us/step - loss: 0.5969 - accuracy: 0.6852
Epoch 20/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5965 - accuracy: 0.6848
Epoch 21/24
20000/20000 [==============================] - 0s 4us/step - loss: 0.5963 - accuracy: 0.6862
Epoch 22/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5959 - accuracy: 0.6855
Epoch 23/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5956 - accuracy: 0.6861
Epoch 24/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5950 - accuracy: 0.6854
5697/5697 [==============================] - 0s 18us/step
Epoch 1/25
20000/20000 [==============================] - 0s 10us/step - loss: 0.6833 - accuracy: 0.5972
Epoch 2/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6477 - accuracy: 0.6523
Epoch 3/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6314 - accuracy: 0.6712
Epoch 4/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6214 - accuracy: 0.6776
Epoch 5/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6154 - accuracy: 0.6798
Epoch 6/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6116 - accuracy: 0.6812
Epoch 7/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6090 - accuracy: 0.6816
Epoch 8/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6069 - accuracy: 0.6819
Epoch 9/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6055 - accuracy: 0.6828
Epoch 10/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6044 - accuracy: 0.6829
Epoch 11/25
20000/20000 [==============================] - 0s 4us/step - loss: 0.6034 - accuracy: 0.6834
Epoch 12/25
20000/20000 [==============================] - 0s 4us/step - loss: 0.6027 - accuracy: 0.6834
Epoch 13/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6021 - accuracy: 0.6827
Epoch 14/25
20000/20000 [==============================] - 0s 4us/step - loss: 0.6011 - accuracy: 0.6828
Epoch 15/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6008 - accuracy: 0.6827
Epoch 16/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6001 - accuracy: 0.6836
Epoch 17/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5994 - accuracy: 0.6834
Epoch 18/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5994 - accuracy: 0.6832
Epoch 19/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5987 - accuracy: 0.6844
Epoch 20/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5983 - accuracy: 0.6852
Epoch 21/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5982 - accuracy: 0.6842
Epoch 22/25
20000/20000 [==============================] - 0s 4us/step - loss: 0.5975 - accuracy: 0.6848
Epoch 23/25
20000/20000 [==============================] - 0s 4us/step - loss: 0.5971 - accuracy: 0.6838
Epoch 24/25
20000/20000 [==============================] - 0s 4us/step - loss: 0.5971 - accuracy: 0.6844
Epoch 25/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5966 - accuracy: 0.6842
5697/5697 [==============================] - 0s 19us/step
Epoch 1/26
20000/20000 [==============================] - 0s 11us/step - loss: 0.6745 - accuracy: 0.6065
Epoch 2/26
20000/20000 [==============================] - 0s 6us/step - loss: 0.6466 - accuracy: 0.6562
Epoch 3/26
20000/20000 [==============================] - 0s 6us/step - loss: 0.6319 - accuracy: 0.6677
Epoch 4/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6228 - accuracy: 0.6750
Epoch 5/26
20000/20000 [==============================] - 0s 4us/step - loss: 0.6172 - accuracy: 0.6786
Epoch 6/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6131 - accuracy: 0.6811
Epoch 7/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6105 - accuracy: 0.6823
Epoch 8/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6083 - accuracy: 0.6827
Epoch 9/26
20000/20000 [==============================] - 0s 4us/step - loss: 0.6068 - accuracy: 0.6836
Epoch 10/26
20000/20000 [==============================] - 0s 4us/step - loss: 0.6055 - accuracy: 0.6835
Epoch 11/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6044 - accuracy: 0.6844
Epoch 12/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6034 - accuracy: 0.6838
Epoch 13/26
20000/20000 [==============================] - 0s 4us/step - loss: 0.6024 - accuracy: 0.6845
Epoch 14/26
20000/20000 [==============================] - 0s 4us/step - loss: 0.6016 - accuracy: 0.6848
Epoch 15/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6011 - accuracy: 0.6848
Epoch 16/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6005 - accuracy: 0.6848
Epoch 17/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5999 - accuracy: 0.6857
Epoch 18/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5994 - accuracy: 0.6851
Epoch 19/26
20000/20000 [==============================] - 0s 4us/step - loss: 0.5987 - accuracy: 0.6859
Epoch 20/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5984 - accuracy: 0.6851
Epoch 21/26
20000/20000 [==============================] - 0s 4us/step - loss: 0.5978 - accuracy: 0.6846
Epoch 22/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5975 - accuracy: 0.6856
Epoch 23/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5972 - accuracy: 0.6859
Epoch 24/26
20000/20000 [==============================] - 0s 6us/step - loss: 0.5966 - accuracy: 0.6854
Epoch 25/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5964 - accuracy: 0.6865
Epoch 26/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5960 - accuracy: 0.6861
5697/5697 [==============================] - 0s 19us/step
Epoch 1/27
20000/20000 [==============================] - 0s 11us/step - loss: 0.6906 - accuracy: 0.5749
Epoch 2/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6516 - accuracy: 0.6441
Epoch 3/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6349 - accuracy: 0.6655
Epoch 4/27
20000/20000 [==============================] - 0s 4us/step - loss: 0.6237 - accuracy: 0.6751
Epoch 5/27
20000/20000 [==============================] - 0s 4us/step - loss: 0.6168 - accuracy: 0.6791
Epoch 6/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6124 - accuracy: 0.6799
Epoch 7/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6093 - accuracy: 0.6812
Epoch 8/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6073 - accuracy: 0.6817
Epoch 9/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6058 - accuracy: 0.6822
Epoch 10/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6043 - accuracy: 0.6819
Epoch 11/27
20000/20000 [==============================] - 0s 4us/step - loss: 0.6033 - accuracy: 0.6832
Epoch 12/27
20000/20000 [==============================] - 0s 4us/step - loss: 0.6023 - accuracy: 0.6834
Epoch 13/27
20000/20000 [==============================] - 0s 4us/step - loss: 0.6014 - accuracy: 0.6836
Epoch 14/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6007 - accuracy: 0.6830
Epoch 15/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6001 - accuracy: 0.6837
Epoch 16/27
20000/20000 [==============================] - 0s 6us/step - loss: 0.5994 - accuracy: 0.6842
Epoch 17/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5990 - accuracy: 0.6842
Epoch 18/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5982 - accuracy: 0.6846
Epoch 19/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5980 - accuracy: 0.6845
Epoch 20/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5976 - accuracy: 0.6846
Epoch 21/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5971 - accuracy: 0.6855
Epoch 22/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5967 - accuracy: 0.6856
Epoch 23/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5963 - accuracy: 0.6856
Epoch 24/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5959 - accuracy: 0.6865
Epoch 25/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5955 - accuracy: 0.6861
Epoch 26/27
20000/20000 [==============================] - 0s 6us/step - loss: 0.5952 - accuracy: 0.6857
Epoch 27/27
20000/20000 [==============================] - 0s 6us/step - loss: 0.5947 - accuracy: 0.6855
5697/5697 [==============================] - 0s 18us/step
Epoch 1/28
20000/20000 [==============================] - 0s 10us/step - loss: 0.6892 - accuracy: 0.5536
Epoch 2/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6423 - accuracy: 0.6549
Epoch 3/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6238 - accuracy: 0.6738
Epoch 4/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6155 - accuracy: 0.6784
Epoch 5/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6110 - accuracy: 0.6805
Epoch 6/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6086 - accuracy: 0.6800
Epoch 7/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6068 - accuracy: 0.6812
Epoch 8/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6055 - accuracy: 0.6813
Epoch 9/28
20000/20000 [==============================] - 0s 6us/step - loss: 0.6044 - accuracy: 0.6811
Epoch 10/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6033 - accuracy: 0.6812
Epoch 11/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6025 - accuracy: 0.6823
Epoch 12/28
20000/20000 [==============================] - 0s 4us/step - loss: 0.6021 - accuracy: 0.6824
Epoch 13/28
20000/20000 [==============================] - 0s 4us/step - loss: 0.6014 - accuracy: 0.6822
Epoch 14/28
20000/20000 [==============================] - 0s 4us/step - loss: 0.6007 - accuracy: 0.6837
Epoch 15/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6002 - accuracy: 0.6824
Epoch 16/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6000 - accuracy: 0.6827
Epoch 17/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5996 - accuracy: 0.6839
Epoch 18/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5990 - accuracy: 0.6833
Epoch 19/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5985 - accuracy: 0.6841
Epoch 20/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5982 - accuracy: 0.6848
Epoch 21/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5978 - accuracy: 0.6838
Epoch 22/28
20000/20000 [==============================] - 0s 6us/step - loss: 0.5977 - accuracy: 0.6844
Epoch 23/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5970 - accuracy: 0.6844
Epoch 24/28
20000/20000 [==============================] - 0s 4us/step - loss: 0.5969 - accuracy: 0.6852
Epoch 25/28
20000/20000 [==============================] - 0s 4us/step - loss: 0.5967 - accuracy: 0.6854
Epoch 26/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5963 - accuracy: 0.6848
Epoch 27/28
20000/20000 [==============================] - 0s 4us/step - loss: 0.5961 - accuracy: 0.6859
Epoch 28/28
20000/20000 [==============================] - 0s 4us/step - loss: 0.5958 - accuracy: 0.6843
5697/5697 [==============================] - 0s 25us/step
Epoch 1/29
20000/20000 [==============================] - 0s 12us/step - loss: 0.6777 - accuracy: 0.5993
Epoch 2/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6433 - accuracy: 0.6586
Epoch 3/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6286 - accuracy: 0.6712
Epoch 4/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6202 - accuracy: 0.6760
Epoch 5/29
20000/20000 [==============================] - 0s 4us/step - loss: 0.6150 - accuracy: 0.6775
Epoch 6/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6115 - accuracy: 0.6798
Epoch 7/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6092 - accuracy: 0.6798
Epoch 8/29
20000/20000 [==============================] - 0s 4us/step - loss: 0.6074 - accuracy: 0.6815
Epoch 9/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6061 - accuracy: 0.6810
Epoch 10/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6048 - accuracy: 0.6821
Epoch 11/29
20000/20000 [==============================] - 0s 4us/step - loss: 0.6039 - accuracy: 0.6827
Epoch 12/29
20000/20000 [==============================] - 0s 4us/step - loss: 0.6030 - accuracy: 0.6827
Epoch 13/29
20000/20000 [==============================] - 0s 4us/step - loss: 0.6021 - accuracy: 0.6831
Epoch 14/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.6017 - accuracy: 0.6824
Epoch 15/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6009 - accuracy: 0.6831
Epoch 16/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6002 - accuracy: 0.6839
Epoch 17/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5997 - accuracy: 0.6834
Epoch 18/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5991 - accuracy: 0.6837
Epoch 19/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5985 - accuracy: 0.6835
Epoch 20/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5983 - accuracy: 0.6834
Epoch 21/29
20000/20000 [==============================] - 0s 4us/step - loss: 0.5978 - accuracy: 0.6835
Epoch 22/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5976 - accuracy: 0.6838
Epoch 23/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5967 - accuracy: 0.6836
Epoch 24/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5967 - accuracy: 0.6836
Epoch 25/29
20000/20000 [==============================] - 0s 4us/step - loss: 0.5962 - accuracy: 0.6837
Epoch 26/29
20000/20000 [==============================] - 0s 4us/step - loss: 0.5959 - accuracy: 0.6840
Epoch 27/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5954 - accuracy: 0.6844
Epoch 28/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5953 - accuracy: 0.6850
Epoch 29/29
20000/20000 [==============================] - 0s 4us/step - loss: 0.5950 - accuracy: 0.6842
5697/5697 [==============================] - 0s 18us/step
Epoch 1/30
20000/20000 [==============================] - 0s 10us/step - loss: 0.7036 - accuracy: 0.5507
Epoch 2/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6492 - accuracy: 0.6558
Epoch 3/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6279 - accuracy: 0.6744
Epoch 4/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6184 - accuracy: 0.6789
Epoch 5/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6136 - accuracy: 0.6805
Epoch 6/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6105 - accuracy: 0.6817
Epoch 7/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6081 - accuracy: 0.6825
Epoch 8/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6067 - accuracy: 0.6830
Epoch 9/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6054 - accuracy: 0.6841
Epoch 10/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6044 - accuracy: 0.6830
Epoch 11/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6037 - accuracy: 0.6834
Epoch 12/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6029 - accuracy: 0.6834
Epoch 13/30
20000/20000 [==============================] - 0s 4us/step - loss: 0.6023 - accuracy: 0.6838
Epoch 14/30
20000/20000 [==============================] - 0s 4us/step - loss: 0.6016 - accuracy: 0.6845
Epoch 15/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6013 - accuracy: 0.6844
Epoch 16/30
20000/20000 [==============================] - 0s 4us/step - loss: 0.6008 - accuracy: 0.6846
Epoch 17/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6003 - accuracy: 0.6852
Epoch 18/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6000 - accuracy: 0.6848
Epoch 19/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5996 - accuracy: 0.6848
Epoch 20/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5992 - accuracy: 0.6850
Epoch 21/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5988 - accuracy: 0.6844
Epoch 22/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5985 - accuracy: 0.6858
Epoch 23/30
20000/20000 [==============================] - 0s 4us/step - loss: 0.5980 - accuracy: 0.6863
Epoch 24/30
20000/20000 [==============================] - 0s 4us/step - loss: 0.5979 - accuracy: 0.6869
Epoch 25/30
20000/20000 [==============================] - 0s 4us/step - loss: 0.5974 - accuracy: 0.6870
Epoch 26/30
20000/20000 [==============================] - 0s 4us/step - loss: 0.5971 - accuracy: 0.6864
Epoch 27/30
20000/20000 [==============================] - 0s 4us/step - loss: 0.5967 - accuracy: 0.6866
Epoch 28/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5966 - accuracy: 0.6866
Epoch 29/30
20000/20000 [==============================] - 0s 4us/step - loss: 0.5961 - accuracy: 0.6870
Epoch 30/30
20000/20000 [==============================] - 0s 4us/step - loss: 0.5960 - accuracy: 0.6883
5697/5697 [==============================] - 0s 19us/step
Epoch 1/7
20000/20000 [==============================] - 0s 10us/step - loss: 0.6674 - accuracy: 0.6206
Epoch 2/7
20000/20000 [==============================] - 0s 5us/step - loss: 0.6364 - accuracy: 0.6672
Epoch 3/7
20000/20000 [==============================] - 0s 5us/step - loss: 0.6239 - accuracy: 0.6758
Epoch 4/7
20000/20000 [==============================] - 0s 5us/step - loss: 0.6173 - accuracy: 0.6786
Epoch 5/7
20000/20000 [==============================] - 0s 5us/step - loss: 0.6130 - accuracy: 0.6812
Epoch 6/7
20000/20000 [==============================] - 0s 5us/step - loss: 0.6104 - accuracy: 0.6822
Epoch 7/7
20000/20000 [==============================] - 0s 5us/step - loss: 0.6086 - accuracy: 0.6818
5697/5697 [==============================] - 0s 18us/step
Epoch 1/8
20000/20000 [==============================] - 0s 11us/step - loss: 0.6704 - accuracy: 0.6048
Epoch 2/8
20000/20000 [==============================] - 0s 5us/step - loss: 0.6402 - accuracy: 0.6661
Epoch 3/8
20000/20000 [==============================] - 0s 5us/step - loss: 0.6242 - accuracy: 0.6769
Epoch 4/8
20000/20000 [==============================] - 0s 5us/step - loss: 0.6169 - accuracy: 0.6802
Epoch 5/8
20000/20000 [==============================] - 0s 4us/step - loss: 0.6123 - accuracy: 0.6814
Epoch 6/8
20000/20000 [==============================] - 0s 4us/step - loss: 0.6096 - accuracy: 0.6819
Epoch 7/8
20000/20000 [==============================] - 0s 4us/step - loss: 0.6078 - accuracy: 0.6813
Epoch 8/8
20000/20000 [==============================] - 0s 4us/step - loss: 0.6063 - accuracy: 0.6838
5697/5697 [==============================] - 0s 19us/step
Epoch 1/9
20000/20000 [==============================] - 0s 11us/step - loss: 0.6816 - accuracy: 0.5683
Epoch 2/9
20000/20000 [==============================] - 0s 5us/step - loss: 0.6430 - accuracy: 0.6528
Epoch 3/9
20000/20000 [==============================] - 0s 5us/step - loss: 0.6259 - accuracy: 0.6681
Epoch 4/9
20000/20000 [==============================] - 0s 6us/step - loss: 0.6180 - accuracy: 0.6755
Epoch 5/9
20000/20000 [==============================] - 0s 5us/step - loss: 0.6137 - accuracy: 0.6794
Epoch 6/9
20000/20000 [==============================] - 0s 5us/step - loss: 0.6109 - accuracy: 0.6804
Epoch 7/9
20000/20000 [==============================] - 0s 4us/step - loss: 0.6088 - accuracy: 0.6817
Epoch 8/9
20000/20000 [==============================] - 0s 4us/step - loss: 0.6074 - accuracy: 0.6816
Epoch 9/9
20000/20000 [==============================] - 0s 5us/step - loss: 0.6060 - accuracy: 0.6827
5697/5697 [==============================] - 0s 17us/step
Epoch 1/10
20000/20000 [==============================] - 0s 11us/step - loss: 0.6732 - accuracy: 0.5967
Epoch 2/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.6448 - accuracy: 0.6582
Epoch 3/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.6288 - accuracy: 0.6736
Epoch 4/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.6197 - accuracy: 0.6784
Epoch 5/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.6149 - accuracy: 0.6803
Epoch 6/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.6114 - accuracy: 0.6813
Epoch 7/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.6090 - accuracy: 0.6821
Epoch 8/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.6074 - accuracy: 0.6819
Epoch 9/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.6058 - accuracy: 0.6823
Epoch 10/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.6046 - accuracy: 0.6834
5697/5697 [==============================] - 0s 20us/step
Epoch 1/11
20000/20000 [==============================] - 0s 11us/step - loss: 0.6729 - accuracy: 0.6015
Epoch 2/11
20000/20000 [==============================] - 0s 5us/step - loss: 0.6436 - accuracy: 0.6598
Epoch 3/11
20000/20000 [==============================] - 0s 5us/step - loss: 0.6277 - accuracy: 0.6736
Epoch 4/11
20000/20000 [==============================] - 0s 5us/step - loss: 0.6191 - accuracy: 0.6765
Epoch 5/11
20000/20000 [==============================] - 0s 4us/step - loss: 0.6138 - accuracy: 0.6807
Epoch 6/11
20000/20000 [==============================] - 0s 4us/step - loss: 0.6111 - accuracy: 0.6806
Epoch 7/11
20000/20000 [==============================] - 0s 5us/step - loss: 0.6086 - accuracy: 0.6821
Epoch 8/11
20000/20000 [==============================] - 0s 5us/step - loss: 0.6071 - accuracy: 0.6817
Epoch 9/11
20000/20000 [==============================] - 0s 5us/step - loss: 0.6059 - accuracy: 0.6817
Epoch 10/11
20000/20000 [==============================] - 0s 5us/step - loss: 0.6049 - accuracy: 0.6830
Epoch 11/11
20000/20000 [==============================] - 0s 5us/step - loss: 0.6038 - accuracy: 0.6836
5697/5697 [==============================] - 0s 17us/step
Epoch 1/12
20000/20000 [==============================] - 0s 11us/step - loss: 0.6737 - accuracy: 0.5857
Epoch 2/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6440 - accuracy: 0.6530
Epoch 3/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6297 - accuracy: 0.6729
Epoch 4/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6204 - accuracy: 0.6785
Epoch 5/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6151 - accuracy: 0.6799
Epoch 6/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6116 - accuracy: 0.6807
Epoch 7/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6093 - accuracy: 0.6820
Epoch 8/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6076 - accuracy: 0.6826
Epoch 9/12
20000/20000 [==============================] - 0s 6us/step - loss: 0.6061 - accuracy: 0.6826
Epoch 10/12
20000/20000 [==============================] - 0s 6us/step - loss: 0.6050 - accuracy: 0.6834
Epoch 11/12
20000/20000 [==============================] - 0s 4us/step - loss: 0.6038 - accuracy: 0.6834
Epoch 12/12
20000/20000 [==============================] - 0s 4us/step - loss: 0.6029 - accuracy: 0.6844
5697/5697 [==============================] - 0s 21us/step
Epoch 1/13
20000/20000 [==============================] - 0s 11us/step - loss: 0.6805 - accuracy: 0.5981
Epoch 2/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6452 - accuracy: 0.6579
Epoch 3/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6287 - accuracy: 0.6725
Epoch 4/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6197 - accuracy: 0.6768
Epoch 5/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6148 - accuracy: 0.6783
Epoch 6/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6115 - accuracy: 0.6801
Epoch 7/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6093 - accuracy: 0.6809
Epoch 8/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6072 - accuracy: 0.6813
Epoch 9/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6059 - accuracy: 0.6825
Epoch 10/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6047 - accuracy: 0.6826
Epoch 11/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6038 - accuracy: 0.6820
Epoch 12/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6026 - accuracy: 0.6832
Epoch 13/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6020 - accuracy: 0.6836
5697/5697 [==============================] - 0s 18us/step
Epoch 1/14
20000/20000 [==============================] - 0s 10us/step - loss: 0.6699 - accuracy: 0.6105
Epoch 2/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6377 - accuracy: 0.6582
Epoch 3/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6227 - accuracy: 0.6743
Epoch 4/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6144 - accuracy: 0.6793
Epoch 5/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6099 - accuracy: 0.6813
Epoch 6/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6070 - accuracy: 0.6815
Epoch 7/14
20000/20000 [==============================] - 0s 4us/step - loss: 0.6053 - accuracy: 0.6819
Epoch 8/14
20000/20000 [==============================] - 0s 4us/step - loss: 0.6040 - accuracy: 0.6837
Epoch 9/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6034 - accuracy: 0.6821
Epoch 10/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6022 - accuracy: 0.6833
Epoch 11/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6017 - accuracy: 0.6832
Epoch 12/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6009 - accuracy: 0.6844
Epoch 13/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6004 - accuracy: 0.6840
Epoch 14/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.5998 - accuracy: 0.6851
5697/5697 [==============================] - 0s 19us/step
Epoch 1/15
20000/20000 [==============================] - 0s 10us/step - loss: 0.6796 - accuracy: 0.6015
Epoch 2/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6375 - accuracy: 0.6653
Epoch 3/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6232 - accuracy: 0.6768
Epoch 4/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6163 - accuracy: 0.6794
Epoch 5/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6120 - accuracy: 0.6804
Epoch 6/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6095 - accuracy: 0.6811
Epoch 7/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6075 - accuracy: 0.6819
Epoch 8/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6063 - accuracy: 0.6813
Epoch 9/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6051 - accuracy: 0.6821
Epoch 10/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6043 - accuracy: 0.6817
Epoch 11/15
20000/20000 [==============================] - 0s 4us/step - loss: 0.6035 - accuracy: 0.6823
Epoch 12/15
20000/20000 [==============================] - 0s 4us/step - loss: 0.6028 - accuracy: 0.6831
Epoch 13/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6021 - accuracy: 0.6836
Epoch 14/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6015 - accuracy: 0.6832
Epoch 15/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6012 - accuracy: 0.6842
5697/5697 [==============================] - 0s 20us/step
Epoch 1/16
20000/20000 [==============================] - 0s 10us/step - loss: 0.6621 - accuracy: 0.6233
Epoch 2/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6354 - accuracy: 0.6666
Epoch 3/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6241 - accuracy: 0.6730
Epoch 4/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6175 - accuracy: 0.6781
Epoch 5/16
20000/20000 [==============================] - 0s 7us/step - loss: 0.6137 - accuracy: 0.6792
Epoch 6/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6110 - accuracy: 0.6807
Epoch 7/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6089 - accuracy: 0.6803
Epoch 8/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6073 - accuracy: 0.6816
Epoch 9/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6063 - accuracy: 0.6831
Epoch 10/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6053 - accuracy: 0.6826
Epoch 11/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6045 - accuracy: 0.6842
Epoch 12/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6038 - accuracy: 0.6842
Epoch 13/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6031 - accuracy: 0.6840
Epoch 14/16
20000/20000 [==============================] - 0s 4us/step - loss: 0.6026 - accuracy: 0.6833
Epoch 15/16
20000/20000 [==============================] - 0s 4us/step - loss: 0.6018 - accuracy: 0.6838
Epoch 16/16
20000/20000 [==============================] - 0s 4us/step - loss: 0.6015 - accuracy: 0.6841
5697/5697 [==============================] - 0s 18us/step
Epoch 1/17
20000/20000 [==============================] - 0s 10us/step - loss: 0.6671 - accuracy: 0.6104
Epoch 2/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6344 - accuracy: 0.6664
Epoch 3/17
20000/20000 [==============================] - 0s 4us/step - loss: 0.6218 - accuracy: 0.6762
Epoch 4/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6156 - accuracy: 0.6799
Epoch 5/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6116 - accuracy: 0.6804
Epoch 6/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6089 - accuracy: 0.6815
Epoch 7/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6070 - accuracy: 0.6819
Epoch 8/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6056 - accuracy: 0.6826
Epoch 9/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6044 - accuracy: 0.6823
Epoch 10/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6033 - accuracy: 0.6823
Epoch 11/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6024 - accuracy: 0.6829
Epoch 12/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6022 - accuracy: 0.6830
Epoch 13/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6013 - accuracy: 0.6828
Epoch 14/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6007 - accuracy: 0.6836
Epoch 15/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.5999 - accuracy: 0.6830
Epoch 16/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.5996 - accuracy: 0.6844
Epoch 17/17
20000/20000 [==============================] - 0s 4us/step - loss: 0.5991 - accuracy: 0.6839
5697/5697 [==============================] - 0s 19us/step
Epoch 1/18
20000/20000 [==============================] - 0s 10us/step - loss: 0.6632 - accuracy: 0.6188
Epoch 2/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6337 - accuracy: 0.6612
Epoch 3/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6202 - accuracy: 0.6747
Epoch 4/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6141 - accuracy: 0.6791
Epoch 5/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6103 - accuracy: 0.6805
Epoch 6/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6085 - accuracy: 0.6816
Epoch 7/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6067 - accuracy: 0.6827
Epoch 8/18
20000/20000 [==============================] - 0s 4us/step - loss: 0.6053 - accuracy: 0.6827
Epoch 9/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6041 - accuracy: 0.6841
Epoch 10/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6033 - accuracy: 0.6842
Epoch 11/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6025 - accuracy: 0.6841
Epoch 12/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6020 - accuracy: 0.6846
Epoch 13/18
20000/20000 [==============================] - 0s 4us/step - loss: 0.6012 - accuracy: 0.6849
Epoch 14/18
20000/20000 [==============================] - 0s 4us/step - loss: 0.6007 - accuracy: 0.6844
Epoch 15/18
20000/20000 [==============================] - 0s 4us/step - loss: 0.6004 - accuracy: 0.6848
Epoch 16/18
20000/20000 [==============================] - 0s 4us/step - loss: 0.6000 - accuracy: 0.6860
Epoch 17/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5991 - accuracy: 0.6854
Epoch 18/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5987 - accuracy: 0.6867
5697/5697 [==============================] - 0s 18us/step
Epoch 1/19
20000/20000 [==============================] - 0s 10us/step - loss: 0.6698 - accuracy: 0.6271
Epoch 2/19
20000/20000 [==============================] - 0s 4us/step - loss: 0.6378 - accuracy: 0.6705
Epoch 3/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6246 - accuracy: 0.6766
Epoch 4/19
20000/20000 [==============================] - 0s 4us/step - loss: 0.6176 - accuracy: 0.6781
Epoch 5/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6132 - accuracy: 0.6808
Epoch 6/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6104 - accuracy: 0.6819
Epoch 7/19
20000/20000 [==============================] - 0s 6us/step - loss: 0.6081 - accuracy: 0.6831
Epoch 8/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6066 - accuracy: 0.6824
Epoch 9/19
20000/20000 [==============================] - 0s 4us/step - loss: 0.6050 - accuracy: 0.6830
Epoch 10/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6040 - accuracy: 0.6820
Epoch 11/19
20000/20000 [==============================] - 0s 4us/step - loss: 0.6032 - accuracy: 0.6834
Epoch 12/19
20000/20000 [==============================] - 0s 4us/step - loss: 0.6026 - accuracy: 0.6831
Epoch 13/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6020 - accuracy: 0.6833
Epoch 14/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6012 - accuracy: 0.6841
Epoch 15/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6007 - accuracy: 0.6834
Epoch 16/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6002 - accuracy: 0.6839
Epoch 17/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5997 - accuracy: 0.6841
Epoch 18/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5993 - accuracy: 0.6836
Epoch 19/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5988 - accuracy: 0.6849
5697/5697 [==============================] - 0s 19us/step
Epoch 1/20
20000/20000 [==============================] - 0s 10us/step - loss: 0.6767 - accuracy: 0.5850
Epoch 2/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6436 - accuracy: 0.6557
Epoch 3/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6280 - accuracy: 0.6728
Epoch 4/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6193 - accuracy: 0.6794
Epoch 5/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6141 - accuracy: 0.6815
Epoch 6/20
20000/20000 [==============================] - 0s 4us/step - loss: 0.6110 - accuracy: 0.6823
Epoch 7/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6088 - accuracy: 0.6819
Epoch 8/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6070 - accuracy: 0.6836
Epoch 9/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6059 - accuracy: 0.6831
Epoch 10/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6048 - accuracy: 0.6831
Epoch 11/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6040 - accuracy: 0.6830
Epoch 12/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6030 - accuracy: 0.6844
Epoch 13/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6021 - accuracy: 0.6845
Epoch 14/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6015 - accuracy: 0.6848
Epoch 15/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6009 - accuracy: 0.6845
Epoch 16/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6003 - accuracy: 0.6856
Epoch 17/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6000 - accuracy: 0.6855
Epoch 18/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5991 - accuracy: 0.6855
Epoch 19/20
20000/20000 [==============================] - 0s 7us/step - loss: 0.5987 - accuracy: 0.6855
Epoch 20/20
20000/20000 [==============================] - 0s 8us/step - loss: 0.5983 - accuracy: 0.6857
5697/5697 [==============================] - 0s 16us/step
Epoch 1/21
20000/20000 [==============================] - 0s 13us/step - loss: 0.6852 - accuracy: 0.5901
Epoch 2/21
20000/20000 [==============================] - 0s 4us/step - loss: 0.6461 - accuracy: 0.6440
Epoch 3/21
20000/20000 [==============================] - 0s 4us/step - loss: 0.6272 - accuracy: 0.6656
Epoch 4/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6172 - accuracy: 0.6758
Epoch 5/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6119 - accuracy: 0.6787
Epoch 6/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6086 - accuracy: 0.6807
Epoch 7/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6062 - accuracy: 0.6823
Epoch 8/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6051 - accuracy: 0.6820
Epoch 9/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6041 - accuracy: 0.6842
Epoch 10/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6029 - accuracy: 0.6840
Epoch 11/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6023 - accuracy: 0.6842
Epoch 12/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6012 - accuracy: 0.6843
Epoch 13/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6005 - accuracy: 0.6845
Epoch 14/21
20000/20000 [==============================] - 0s 9us/step - loss: 0.6002 - accuracy: 0.6844
Epoch 15/21
20000/20000 [==============================] - 0s 7us/step - loss: 0.5994 - accuracy: 0.6850
Epoch 16/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5990 - accuracy: 0.6848
Epoch 17/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5985 - accuracy: 0.6849
Epoch 18/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5981 - accuracy: 0.6851
Epoch 19/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5975 - accuracy: 0.6855
Epoch 20/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5969 - accuracy: 0.6852
Epoch 21/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5969 - accuracy: 0.6856
5697/5697 [==============================] - 0s 19us/step
Epoch 1/22
20000/20000 [==============================] - 0s 10us/step - loss: 0.6633 - accuracy: 0.6179
Epoch 2/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6299 - accuracy: 0.6704
Epoch 3/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6196 - accuracy: 0.6783
Epoch 4/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6141 - accuracy: 0.6806
Epoch 5/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6105 - accuracy: 0.6816
Epoch 6/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6081 - accuracy: 0.6819
Epoch 7/22
20000/20000 [==============================] - 0s 6us/step - loss: 0.6064 - accuracy: 0.6823
Epoch 8/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6053 - accuracy: 0.6824
Epoch 9/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6041 - accuracy: 0.6830
Epoch 10/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6032 - accuracy: 0.6834
Epoch 11/22
20000/20000 [==============================] - 0s 4us/step - loss: 0.6024 - accuracy: 0.6834
Epoch 12/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6015 - accuracy: 0.6837
Epoch 13/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6008 - accuracy: 0.6833
Epoch 14/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6004 - accuracy: 0.6838
Epoch 15/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5994 - accuracy: 0.6837
Epoch 16/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5991 - accuracy: 0.6841
Epoch 17/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5987 - accuracy: 0.6845
Epoch 18/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5979 - accuracy: 0.6845
Epoch 19/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5978 - accuracy: 0.6850
Epoch 20/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5972 - accuracy: 0.6842
Epoch 21/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5967 - accuracy: 0.6856
Epoch 22/22
20000/20000 [==============================] - 0s 4us/step - loss: 0.5964 - accuracy: 0.6855
5697/5697 [==============================] - 0s 18us/step
Epoch 1/23
20000/20000 [==============================] - 0s 10us/step - loss: 0.6763 - accuracy: 0.5873
Epoch 2/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6430 - accuracy: 0.6554
Epoch 3/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6262 - accuracy: 0.6744
Epoch 4/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6176 - accuracy: 0.6791
Epoch 5/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6133 - accuracy: 0.6818
Epoch 6/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6102 - accuracy: 0.6817
Epoch 7/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6079 - accuracy: 0.6823
Epoch 8/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6064 - accuracy: 0.6819
Epoch 9/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6053 - accuracy: 0.6824
Epoch 10/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6043 - accuracy: 0.6837
Epoch 11/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6034 - accuracy: 0.6828
Epoch 12/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6023 - accuracy: 0.6832
Epoch 13/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6016 - accuracy: 0.6840
Epoch 14/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6014 - accuracy: 0.6840
Epoch 15/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6005 - accuracy: 0.6849
Epoch 16/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6000 - accuracy: 0.6844
Epoch 17/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5996 - accuracy: 0.6841
Epoch 18/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5989 - accuracy: 0.6851
Epoch 19/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5984 - accuracy: 0.6841
Epoch 20/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5979 - accuracy: 0.6852
Epoch 21/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5975 - accuracy: 0.6855
Epoch 22/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5973 - accuracy: 0.6851
Epoch 23/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5968 - accuracy: 0.6858
5697/5697 [==============================] - 0s 19us/step
Epoch 1/24
20000/20000 [==============================] - 0s 10us/step - loss: 0.6867 - accuracy: 0.5673
Epoch 2/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6503 - accuracy: 0.6465
Epoch 3/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6303 - accuracy: 0.6751
Epoch 4/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6198 - accuracy: 0.6797
Epoch 5/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6144 - accuracy: 0.6811
Epoch 6/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6108 - accuracy: 0.6808
Epoch 7/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6087 - accuracy: 0.6819
Epoch 8/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6069 - accuracy: 0.6822
Epoch 9/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6053 - accuracy: 0.6833
Epoch 10/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6043 - accuracy: 0.6834
Epoch 11/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6036 - accuracy: 0.6834
Epoch 12/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6026 - accuracy: 0.6841
Epoch 13/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6019 - accuracy: 0.6844
Epoch 14/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6012 - accuracy: 0.6832
Epoch 15/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6003 - accuracy: 0.6851
Epoch 16/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6001 - accuracy: 0.6848
Epoch 17/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5989 - accuracy: 0.6841
Epoch 18/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5990 - accuracy: 0.6855
Epoch 19/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5984 - accuracy: 0.6856
Epoch 20/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5980 - accuracy: 0.6855
Epoch 21/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5974 - accuracy: 0.6865
Epoch 22/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5972 - accuracy: 0.6855
Epoch 23/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5965 - accuracy: 0.6862
Epoch 24/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5964 - accuracy: 0.6861
5697/5697 [==============================] - 0s 19us/step
Epoch 1/25
20000/20000 [==============================] - 0s 10us/step - loss: 0.6778 - accuracy: 0.5876
Epoch 2/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6401 - accuracy: 0.6626
Epoch 3/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6252 - accuracy: 0.6732
Epoch 4/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6171 - accuracy: 0.6772
Epoch 5/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6125 - accuracy: 0.6805
Epoch 6/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6095 - accuracy: 0.6813
Epoch 7/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6074 - accuracy: 0.6827
Epoch 8/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6059 - accuracy: 0.6825
Epoch 9/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6049 - accuracy: 0.6833
Epoch 10/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6035 - accuracy: 0.6832
Epoch 11/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6030 - accuracy: 0.6830
Epoch 12/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6023 - accuracy: 0.6837
Epoch 13/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6015 - accuracy: 0.6842
Epoch 14/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6010 - accuracy: 0.6844: 0s - loss: 0.6024 - accuracy: 0.68
Epoch 15/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6004 - accuracy: 0.6846
Epoch 16/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5997 - accuracy: 0.6850
Epoch 17/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5992 - accuracy: 0.6852
Epoch 18/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5988 - accuracy: 0.6854
Epoch 19/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5984 - accuracy: 0.6857
Epoch 20/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5982 - accuracy: 0.6866
Epoch 21/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5977 - accuracy: 0.6859
Epoch 22/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5968 - accuracy: 0.6861
Epoch 23/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5969 - accuracy: 0.6851
Epoch 24/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5964 - accuracy: 0.6860
Epoch 25/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5960 - accuracy: 0.6861
5697/5697 [==============================] - 0s 18us/step
Epoch 1/26
20000/20000 [==============================] - 0s 10us/step - loss: 0.6815 - accuracy: 0.5732
Epoch 2/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6438 - accuracy: 0.6596
Epoch 3/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6257 - accuracy: 0.6749
Epoch 4/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6171 - accuracy: 0.6783
Epoch 5/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6127 - accuracy: 0.6801
Epoch 6/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6100 - accuracy: 0.6812
Epoch 7/26
20000/20000 [==============================] - 0s 6us/step - loss: 0.6082 - accuracy: 0.6820
Epoch 8/26
20000/20000 [==============================] - 0s 6us/step - loss: 0.6067 - accuracy: 0.6820
Epoch 9/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6054 - accuracy: 0.6822
Epoch 10/26
20000/20000 [==============================] - 0s 4us/step - loss: 0.6047 - accuracy: 0.6827
Epoch 11/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6039 - accuracy: 0.6829
Epoch 12/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6030 - accuracy: 0.6829
Epoch 13/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6024 - accuracy: 0.6834
Epoch 14/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6018 - accuracy: 0.6845
Epoch 15/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6012 - accuracy: 0.6840
Epoch 16/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6008 - accuracy: 0.6840
Epoch 17/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6003 - accuracy: 0.6848
Epoch 18/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5997 - accuracy: 0.6855
Epoch 19/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5993 - accuracy: 0.6855
Epoch 20/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5990 - accuracy: 0.6852
Epoch 21/26
20000/20000 [==============================] - 0s 4us/step - loss: 0.5988 - accuracy: 0.6854
Epoch 22/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5980 - accuracy: 0.6867
Epoch 23/26
20000/20000 [==============================] - 0s 8us/step - loss: 0.5977 - accuracy: 0.6848
Epoch 24/26
20000/20000 [==============================] - 0s 7us/step - loss: 0.5973 - accuracy: 0.6858
Epoch 25/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5971 - accuracy: 0.6859
Epoch 26/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5970 - accuracy: 0.6855
5697/5697 [==============================] - 0s 20us/step
Epoch 1/27
20000/20000 [==============================] - 0s 24us/step - loss: 0.6894 - accuracy: 0.5551
Epoch 2/27
20000/20000 [==============================] - 0s 7us/step - loss: 0.6553 - accuracy: 0.6371
Epoch 3/27
20000/20000 [==============================] - 0s 7us/step - loss: 0.6348 - accuracy: 0.6657
Epoch 4/27
20000/20000 [==============================] - 0s 8us/step - loss: 0.6232 - accuracy: 0.6743
Epoch 5/27
20000/20000 [==============================] - 0s 11us/step - loss: 0.6165 - accuracy: 0.6780
Epoch 6/27
20000/20000 [==============================] - 0s 8us/step - loss: 0.6124 - accuracy: 0.6791
Epoch 7/27
20000/20000 [==============================] - 0s 9us/step - loss: 0.6097 - accuracy: 0.6808
Epoch 8/27
20000/20000 [==============================] - 0s 7us/step - loss: 0.6076 - accuracy: 0.6815
Epoch 9/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6059 - accuracy: 0.6823
Epoch 10/27
20000/20000 [==============================] - 0s 6us/step - loss: 0.6044 - accuracy: 0.6827
Epoch 11/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6033 - accuracy: 0.6827
Epoch 12/27
20000/20000 [==============================] - 0s 6us/step - loss: 0.6023 - accuracy: 0.6837
Epoch 13/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6016 - accuracy: 0.6841
Epoch 14/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6008 - accuracy: 0.6834
Epoch 15/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6000 - accuracy: 0.6830
Epoch 16/27
20000/20000 [==============================] - 0s 6us/step - loss: 0.5996 - accuracy: 0.6847
Epoch 17/27
20000/20000 [==============================] - 0s 10us/step - loss: 0.5988 - accuracy: 0.6847
Epoch 18/27
20000/20000 [==============================] - 0s 9us/step - loss: 0.5982 - accuracy: 0.6848
Epoch 19/27
20000/20000 [==============================] - 0s 10us/step - loss: 0.5977 - accuracy: 0.6848
Epoch 20/27
20000/20000 [==============================] - 0s 6us/step - loss: 0.5972 - accuracy: 0.6842
Epoch 21/27
20000/20000 [==============================] - 0s 7us/step - loss: 0.5968 - accuracy: 0.6858
Epoch 22/27
20000/20000 [==============================] - 0s 7us/step - loss: 0.5963 - accuracy: 0.6858
Epoch 23/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5958 - accuracy: 0.6859
Epoch 24/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5954 - accuracy: 0.6856
Epoch 25/27
20000/20000 [==============================] - 0s 6us/step - loss: 0.5951 - accuracy: 0.6869
Epoch 26/27
20000/20000 [==============================] - 0s 6us/step - loss: 0.5948 - accuracy: 0.6854
Epoch 27/27
20000/20000 [==============================] - 0s 6us/step - loss: 0.5945 - accuracy: 0.6861
5697/5697 [==============================] - 0s 43us/step
Epoch 1/28
20000/20000 [==============================] - 0s 13us/step - loss: 0.6701 - accuracy: 0.6112
Epoch 2/28
20000/20000 [==============================] - 0s 7us/step - loss: 0.6346 - accuracy: 0.6619
Epoch 3/28
20000/20000 [==============================] - 0s 7us/step - loss: 0.6214 - accuracy: 0.6734
Epoch 4/28
20000/20000 [==============================] - 0s 7us/step - loss: 0.6148 - accuracy: 0.6781
Epoch 5/28
20000/20000 [==============================] - 0s 9us/step - loss: 0.6108 - accuracy: 0.6798
Epoch 6/28
20000/20000 [==============================] - 0s 7us/step - loss: 0.6080 - accuracy: 0.6828
Epoch 7/28
20000/20000 [==============================] - 0s 8us/step - loss: 0.6061 - accuracy: 0.6830
Epoch 8/28
20000/20000 [==============================] - 0s 7us/step - loss: 0.6047 - accuracy: 0.6834
Epoch 9/28
20000/20000 [==============================] - 0s 7us/step - loss: 0.6035 - accuracy: 0.6831
Epoch 10/28
20000/20000 [==============================] - 0s 7us/step - loss: 0.6025 - accuracy: 0.6844
Epoch 11/28
20000/20000 [==============================] - 0s 8us/step - loss: 0.6014 - accuracy: 0.6853
Epoch 12/28
20000/20000 [==============================] - 0s 8us/step - loss: 0.6006 - accuracy: 0.6853
Epoch 13/28
20000/20000 [==============================] - 0s 8us/step - loss: 0.5999 - accuracy: 0.6858
Epoch 14/28
20000/20000 [==============================] - 0s 8us/step - loss: 0.5994 - accuracy: 0.6854
Epoch 15/28
20000/20000 [==============================] - 0s 8us/step - loss: 0.5985 - accuracy: 0.6866
Epoch 16/28
20000/20000 [==============================] - 0s 8us/step - loss: 0.5983 - accuracy: 0.6865
Epoch 17/28
20000/20000 [==============================] - 0s 9us/step - loss: 0.5976 - accuracy: 0.6859
Epoch 18/28
20000/20000 [==============================] - 0s 8us/step - loss: 0.5973 - accuracy: 0.6862
Epoch 19/28
20000/20000 [==============================] - 0s 6us/step - loss: 0.5965 - accuracy: 0.6865
Epoch 20/28
20000/20000 [==============================] - 0s 6us/step - loss: 0.5963 - accuracy: 0.6866
Epoch 21/28
20000/20000 [==============================] - 0s 6us/step - loss: 0.5960 - accuracy: 0.6870
Epoch 22/28
20000/20000 [==============================] - 0s 6us/step - loss: 0.5955 - accuracy: 0.6876
Epoch 23/28
20000/20000 [==============================] - 0s 6us/step - loss: 0.5953 - accuracy: 0.6882
Epoch 24/28
20000/20000 [==============================] - 0s 7us/step - loss: 0.5947 - accuracy: 0.6880
Epoch 25/28
20000/20000 [==============================] - 0s 7us/step - loss: 0.5945 - accuracy: 0.6880
Epoch 26/28
20000/20000 [==============================] - 0s 7us/step - loss: 0.5943 - accuracy: 0.6891
Epoch 27/28
20000/20000 [==============================] - 0s 7us/step - loss: 0.5940 - accuracy: 0.6880
Epoch 28/28
20000/20000 [==============================] - 0s 7us/step - loss: 0.5933 - accuracy: 0.6885
5697/5697 [==============================] - 0s 24us/step
Epoch 1/29
20000/20000 [==============================] - 0s 14us/step - loss: 0.6729 - accuracy: 0.5953
Epoch 2/29
20000/20000 [==============================] - 0s 7us/step - loss: 0.6392 - accuracy: 0.6634
Epoch 3/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.6236 - accuracy: 0.6736
Epoch 4/29
20000/20000 [==============================] - 0s 7us/step - loss: 0.6160 - accuracy: 0.6791
Epoch 5/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6118 - accuracy: 0.6816
Epoch 6/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6093 - accuracy: 0.6820
Epoch 7/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.6073 - accuracy: 0.6825
Epoch 8/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.6060 - accuracy: 0.6830
Epoch 9/29
20000/20000 [==============================] - 0s 7us/step - loss: 0.6046 - accuracy: 0.6830
Epoch 10/29
20000/20000 [==============================] - 0s 7us/step - loss: 0.6039 - accuracy: 0.6830
Epoch 11/29
20000/20000 [==============================] - 0s 7us/step - loss: 0.6030 - accuracy: 0.6837
Epoch 12/29
20000/20000 [==============================] - 0s 7us/step - loss: 0.6020 - accuracy: 0.6842
Epoch 13/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.6017 - accuracy: 0.6832
Epoch 14/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6009 - accuracy: 0.6824
Epoch 15/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6003 - accuracy: 0.6843
Epoch 16/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5998 - accuracy: 0.6831
Epoch 17/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5994 - accuracy: 0.6855
Epoch 18/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5989 - accuracy: 0.6844
Epoch 19/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5986 - accuracy: 0.6851
Epoch 20/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5980 - accuracy: 0.6856
Epoch 21/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5974 - accuracy: 0.6849
Epoch 22/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5972 - accuracy: 0.6852
Epoch 23/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.5967 - accuracy: 0.6861
Epoch 24/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5962 - accuracy: 0.6862
Epoch 25/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5959 - accuracy: 0.6854
Epoch 26/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.5957 - accuracy: 0.6868
Epoch 27/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5951 - accuracy: 0.6870
Epoch 28/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5949 - accuracy: 0.6861
Epoch 29/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5945 - accuracy: 0.6866
5697/5697 [==============================] - 0s 21us/step
Epoch 1/30
20000/20000 [==============================] - 0s 15us/step - loss: 0.6758 - accuracy: 0.6086
Epoch 2/30
20000/20000 [==============================] - 0s 8us/step - loss: 0.6421 - accuracy: 0.6585
Epoch 3/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6274 - accuracy: 0.6745
Epoch 4/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6186 - accuracy: 0.6772
Epoch 5/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.6133 - accuracy: 0.6802
Epoch 6/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6100 - accuracy: 0.6824
Epoch 7/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.6078 - accuracy: 0.6823
Epoch 8/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6060 - accuracy: 0.6831
Epoch 9/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.6046 - accuracy: 0.6833
Epoch 10/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6035 - accuracy: 0.6833
Epoch 11/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.6025 - accuracy: 0.6837
Epoch 12/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.6016 - accuracy: 0.6841
Epoch 13/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.6007 - accuracy: 0.6837
Epoch 14/30
20000/20000 [==============================] - 0s 12us/step - loss: 0.6000 - accuracy: 0.6834
Epoch 15/30
20000/20000 [==============================] - 0s 9us/step - loss: 0.5994 - accuracy: 0.6841
Epoch 16/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.5988 - accuracy: 0.6840
Epoch 17/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5982 - accuracy: 0.6858
Epoch 18/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5979 - accuracy: 0.6854
Epoch 19/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5972 - accuracy: 0.6856
Epoch 20/30
20000/20000 [==============================] - 0s 8us/step - loss: 0.5967 - accuracy: 0.6857
Epoch 21/30
20000/20000 [==============================] - 0s 9us/step - loss: 0.5964 - accuracy: 0.6856
Epoch 22/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.5960 - accuracy: 0.6866
Epoch 23/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5956 - accuracy: 0.6849
Epoch 24/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.5954 - accuracy: 0.6862
Epoch 25/30
20000/20000 [==============================] - 0s 8us/step - loss: 0.5951 - accuracy: 0.6865
Epoch 26/30
20000/20000 [==============================] - 0s 9us/step - loss: 0.5946 - accuracy: 0.6876
Epoch 27/30
20000/20000 [==============================] - 0s 7us/step - loss: 0.5944 - accuracy: 0.6869
Epoch 28/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5939 - accuracy: 0.6873
Epoch 29/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5935 - accuracy: 0.6870
Epoch 30/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5932 - accuracy: 0.6866
5697/5697 [==============================] - 0s 19us/step
Epoch 1/7
20000/20000 [==============================] - 0s 11us/step - loss: 0.6719 - accuracy: 0.6072
Epoch 2/7
20000/20000 [==============================] - 0s 5us/step - loss: 0.6370 - accuracy: 0.6683
Epoch 3/7
20000/20000 [==============================] - 0s 7us/step - loss: 0.6225 - accuracy: 0.6780
Epoch 4/7
20000/20000 [==============================] - 0s 8us/step - loss: 0.6148 - accuracy: 0.6809
Epoch 5/7
20000/20000 [==============================] - 0s 6us/step - loss: 0.6101 - accuracy: 0.6827
Epoch 6/7
20000/20000 [==============================] - 0s 7us/step - loss: 0.6072 - accuracy: 0.6838
Epoch 7/7
20000/20000 [==============================] - 0s 8us/step - loss: 0.6052 - accuracy: 0.6838
5697/5697 [==============================] - 0s 18us/step
Epoch 1/8
20000/20000 [==============================] - 0s 23us/step - loss: 0.6926 - accuracy: 0.5728
Epoch 2/8
20000/20000 [==============================] - 0s 5us/step - loss: 0.6374 - accuracy: 0.6607
Epoch 3/8
20000/20000 [==============================] - 0s 5us/step - loss: 0.6211 - accuracy: 0.6773
Epoch 4/8
20000/20000 [==============================] - 0s 6us/step - loss: 0.6131 - accuracy: 0.6808
Epoch 5/8
20000/20000 [==============================] - 0s 6us/step - loss: 0.6086 - accuracy: 0.6813
Epoch 6/8
20000/20000 [==============================] - 0s 6us/step - loss: 0.6057 - accuracy: 0.6824
Epoch 7/8
20000/20000 [==============================] - 0s 5us/step - loss: 0.6036 - accuracy: 0.6824
Epoch 8/8
20000/20000 [==============================] - 0s 5us/step - loss: 0.6022 - accuracy: 0.6838
5697/5697 [==============================] - 0s 19us/step
Epoch 1/9
20000/20000 [==============================] - 0s 11us/step - loss: 0.6835 - accuracy: 0.5868
Epoch 2/9
20000/20000 [==============================] - 0s 6us/step - loss: 0.6405 - accuracy: 0.6629
Epoch 3/9
20000/20000 [==============================] - 0s 6us/step - loss: 0.6236 - accuracy: 0.6786
Epoch 4/9
20000/20000 [==============================] - 0s 6us/step - loss: 0.6151 - accuracy: 0.6812
Epoch 5/9
20000/20000 [==============================] - 0s 5us/step - loss: 0.6100 - accuracy: 0.6816
Epoch 6/9
20000/20000 [==============================] - 0s 5us/step - loss: 0.6067 - accuracy: 0.6817
Epoch 7/9
20000/20000 [==============================] - 0s 7us/step - loss: 0.6044 - accuracy: 0.6834
Epoch 8/9
20000/20000 [==============================] - 0s 9us/step - loss: 0.6030 - accuracy: 0.6831
Epoch 9/9
20000/20000 [==============================] - 0s 8us/step - loss: 0.6021 - accuracy: 0.6838
5697/5697 [==============================] - 0s 21us/step
Epoch 1/10
20000/20000 [==============================] - 0s 19us/step - loss: 0.6785 - accuracy: 0.5855
Epoch 2/10
20000/20000 [==============================] - 0s 7us/step - loss: 0.6361 - accuracy: 0.6629
Epoch 3/10
20000/20000 [==============================] - 0s 8us/step - loss: 0.6203 - accuracy: 0.6782
Epoch 4/10
20000/20000 [==============================] - 0s 7us/step - loss: 0.6129 - accuracy: 0.6805
Epoch 5/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.6084 - accuracy: 0.6823
Epoch 6/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.6057 - accuracy: 0.6824
Epoch 7/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.6039 - accuracy: 0.6834
Epoch 8/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.6022 - accuracy: 0.6831
Epoch 9/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.6011 - accuracy: 0.6838
Epoch 10/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.6002 - accuracy: 0.6852
5697/5697 [==============================] - 0s 18us/step
Epoch 1/11
20000/20000 [==============================] - 0s 10us/step - loss: 0.6859 - accuracy: 0.5780
Epoch 2/11
20000/20000 [==============================] - 0s 5us/step - loss: 0.6386 - accuracy: 0.6569
Epoch 3/11
20000/20000 [==============================] - 0s 5us/step - loss: 0.6221 - accuracy: 0.6763
Epoch 4/11
20000/20000 [==============================] - 0s 5us/step - loss: 0.6144 - accuracy: 0.6803
Epoch 5/11
20000/20000 [==============================] - 0s 5us/step - loss: 0.6102 - accuracy: 0.6809
Epoch 6/11
20000/20000 [==============================] - 0s 5us/step - loss: 0.6076 - accuracy: 0.6819
Epoch 7/11
20000/20000 [==============================] - 0s 6us/step - loss: 0.6053 - accuracy: 0.6830
Epoch 8/11
20000/20000 [==============================] - 0s 5us/step - loss: 0.6039 - accuracy: 0.6830
Epoch 9/11
20000/20000 [==============================] - 0s 5us/step - loss: 0.6024 - accuracy: 0.6847
Epoch 10/11
20000/20000 [==============================] - 0s 5us/step - loss: 0.6012 - accuracy: 0.6844
Epoch 11/11
20000/20000 [==============================] - 0s 5us/step - loss: 0.6006 - accuracy: 0.6840
5697/5697 [==============================] - 0s 17us/step
Epoch 1/12
20000/20000 [==============================] - 0s 11us/step - loss: 0.6892 - accuracy: 0.5872
Epoch 2/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6346 - accuracy: 0.6664
Epoch 3/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6193 - accuracy: 0.6761
Epoch 4/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6118 - accuracy: 0.6782
Epoch 5/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6077 - accuracy: 0.6805
Epoch 6/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6046 - accuracy: 0.6811
Epoch 7/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6031 - accuracy: 0.6821
Epoch 8/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6015 - accuracy: 0.6837
Epoch 9/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6003 - accuracy: 0.6834
Epoch 10/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.5994 - accuracy: 0.6846
Epoch 11/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.5984 - accuracy: 0.6840
Epoch 12/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.5976 - accuracy: 0.6852
5697/5697 [==============================] - 0s 27us/step
Epoch 1/13
20000/20000 [==============================] - 1s 29us/step - loss: 0.7062 - accuracy: 0.5800
Epoch 2/13
20000/20000 [==============================] - 0s 6us/step - loss: 0.6444 - accuracy: 0.6621
Epoch 3/13
20000/20000 [==============================] - 0s 6us/step - loss: 0.6242 - accuracy: 0.6755
Epoch 4/13
20000/20000 [==============================] - 0s 6us/step - loss: 0.6160 - accuracy: 0.6781
Epoch 5/13
20000/20000 [==============================] - 0s 6us/step - loss: 0.6113 - accuracy: 0.6797
Epoch 6/13
20000/20000 [==============================] - 0s 6us/step - loss: 0.6085 - accuracy: 0.6818
Epoch 7/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6061 - accuracy: 0.6826
Epoch 8/13
20000/20000 [==============================] - 0s 6us/step - loss: 0.6046 - accuracy: 0.6826
Epoch 9/13
20000/20000 [==============================] - 0s 6us/step - loss: 0.6033 - accuracy: 0.6830
Epoch 10/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6019 - accuracy: 0.6836
Epoch 11/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6010 - accuracy: 0.6835
Epoch 12/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6002 - accuracy: 0.6838
Epoch 13/13
20000/20000 [==============================] - 0s 6us/step - loss: 0.5994 - accuracy: 0.6830
5697/5697 [==============================] - 0s 20us/step
Epoch 1/14
20000/20000 [==============================] - 0s 11us/step - loss: 0.7112 - accuracy: 0.5832
Epoch 2/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6372 - accuracy: 0.6605
Epoch 3/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6197 - accuracy: 0.6799
Epoch 4/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6132 - accuracy: 0.6822
Epoch 5/14
20000/20000 [==============================] - ETA: 0s - loss: 0.6092 - accuracy: 0.68 - 0s 5us/step - loss: 0.6096 - accuracy: 0.6823
Epoch 6/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6070 - accuracy: 0.6826
Epoch 7/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6049 - accuracy: 0.6830
Epoch 8/14
20000/20000 [==============================] - 0s 6us/step - loss: 0.6037 - accuracy: 0.6844
Epoch 9/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6024 - accuracy: 0.6841
Epoch 10/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6016 - accuracy: 0.6843
Epoch 11/14
20000/20000 [==============================] - 0s 8us/step - loss: 0.6004 - accuracy: 0.6847
Epoch 12/14
20000/20000 [==============================] - ETA: 0s - loss: 0.5984 - accuracy: 0.68 - 0s 6us/step - loss: 0.5995 - accuracy: 0.6845
Epoch 13/14
20000/20000 [==============================] - 0s 6us/step - loss: 0.5987 - accuracy: 0.6848
Epoch 14/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.5984 - accuracy: 0.6854
5697/5697 [==============================] - 0s 31us/step
Epoch 1/15
20000/20000 [==============================] - 0s 11us/step - loss: 0.6902 - accuracy: 0.5763
Epoch 2/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6361 - accuracy: 0.6651
Epoch 3/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6208 - accuracy: 0.6787
Epoch 4/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6135 - accuracy: 0.6805
Epoch 5/15
20000/20000 [==============================] - 0s 4us/step - loss: 0.6100 - accuracy: 0.6812
Epoch 6/15
20000/20000 [==============================] - 0s 4us/step - loss: 0.6070 - accuracy: 0.6831
Epoch 7/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6053 - accuracy: 0.6836
Epoch 8/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6037 - accuracy: 0.6837
Epoch 9/15
20000/20000 [==============================] - 0s 10us/step - loss: 0.6022 - accuracy: 0.6842
Epoch 10/15
20000/20000 [==============================] - 0s 11us/step - loss: 0.6012 - accuracy: 0.6852
Epoch 11/15
20000/20000 [==============================] - 0s 15us/step - loss: 0.5998 - accuracy: 0.6855
Epoch 12/15
20000/20000 [==============================] - 0s 14us/step - loss: 0.5988 - accuracy: 0.6860
Epoch 13/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.5979 - accuracy: 0.6856
Epoch 14/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.5969 - accuracy: 0.6860
Epoch 15/15
20000/20000 [==============================] - 0s 4us/step - loss: 0.5961 - accuracy: 0.6872
5697/5697 [==============================] - 0s 19us/step
Epoch 1/16
20000/20000 [==============================] - 0s 11us/step - loss: 0.6760 - accuracy: 0.5887
Epoch 2/16
20000/20000 [==============================] - 0s 7us/step - loss: 0.6325 - accuracy: 0.6660
Epoch 3/16
20000/20000 [==============================] - 0s 6us/step - loss: 0.6190 - accuracy: 0.6757
Epoch 4/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6128 - accuracy: 0.6803
Epoch 5/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6083 - accuracy: 0.6815
Epoch 6/16
20000/20000 [==============================] - 0s 7us/step - loss: 0.6058 - accuracy: 0.6828
Epoch 7/16
20000/20000 [==============================] - ETA: 0s - loss: 0.6029 - accuracy: 0.68 - 0s 8us/step - loss: 0.6038 - accuracy: 0.6834
Epoch 8/16
20000/20000 [==============================] - 0s 7us/step - loss: 0.6024 - accuracy: 0.6837
Epoch 9/16
20000/20000 [==============================] - 0s 4us/step - loss: 0.6010 - accuracy: 0.6842
Epoch 10/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6003 - accuracy: 0.6845
Epoch 11/16
20000/20000 [==============================] - 0s 4us/step - loss: 0.5992 - accuracy: 0.6845
Epoch 12/16
20000/20000 [==============================] - 0s 4us/step - loss: 0.5985 - accuracy: 0.6844
Epoch 13/16
20000/20000 [==============================] - 0s 4us/step - loss: 0.5980 - accuracy: 0.6844
Epoch 14/16
20000/20000 [==============================] - 0s 4us/step - loss: 0.5971 - accuracy: 0.6848
Epoch 15/16
20000/20000 [==============================] - 0s 4us/step - loss: 0.5967 - accuracy: 0.6853
Epoch 16/16
20000/20000 [==============================] - 0s 4us/step - loss: 0.5961 - accuracy: 0.6863
5697/5697 [==============================] - 0s 18us/step
Epoch 1/17
20000/20000 [==============================] - 0s 10us/step - loss: 0.7305 - accuracy: 0.5737
Epoch 2/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6480 - accuracy: 0.6553
Epoch 3/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6266 - accuracy: 0.6767
Epoch 4/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6171 - accuracy: 0.6802
Epoch 5/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6122 - accuracy: 0.6819
Epoch 6/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6083 - accuracy: 0.6814
Epoch 7/17
20000/20000 [==============================] - 0s 4us/step - loss: 0.6060 - accuracy: 0.6829
Epoch 8/17
20000/20000 [==============================] - 0s 4us/step - loss: 0.6042 - accuracy: 0.6831
Epoch 9/17
20000/20000 [==============================] - 0s 4us/step - loss: 0.6026 - accuracy: 0.6838
Epoch 10/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6012 - accuracy: 0.6844
Epoch 11/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6002 - accuracy: 0.6841
Epoch 12/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.5993 - accuracy: 0.6842
Epoch 13/17
20000/20000 [==============================] - 0s 4us/step - loss: 0.5983 - accuracy: 0.6847
Epoch 14/17
20000/20000 [==============================] - 0s 4us/step - loss: 0.5975 - accuracy: 0.6849
Epoch 15/17
20000/20000 [==============================] - 0s 4us/step - loss: 0.5966 - accuracy: 0.6853
Epoch 16/17
20000/20000 [==============================] - 0s 4us/step - loss: 0.5961 - accuracy: 0.6858
Epoch 17/17
20000/20000 [==============================] - 0s 4us/step - loss: 0.5952 - accuracy: 0.6860
5697/5697 [==============================] - 0s 19us/step
Epoch 1/18
20000/20000 [==============================] - 0s 11us/step - loss: 0.6939 - accuracy: 0.5929
Epoch 2/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6400 - accuracy: 0.6610
Epoch 3/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.6223 - accuracy: 0.6769
Epoch 4/18
20000/20000 [==============================] - 0s 4us/step - loss: 0.6139 - accuracy: 0.6802
Epoch 5/18
20000/20000 [==============================] - 0s 4us/step - loss: 0.6095 - accuracy: 0.6819
Epoch 6/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6070 - accuracy: 0.6823
Epoch 7/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.6048 - accuracy: 0.6817
Epoch 8/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6034 - accuracy: 0.6819
Epoch 9/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6019 - accuracy: 0.6828
Epoch 10/18
20000/20000 [==============================] - 0s 4us/step - loss: 0.6005 - accuracy: 0.6832
Epoch 11/18
20000/20000 [==============================] - 0s 4us/step - loss: 0.5997 - accuracy: 0.6824
Epoch 12/18
20000/20000 [==============================] - 0s 4us/step - loss: 0.5987 - accuracy: 0.6835
Epoch 13/18
20000/20000 [==============================] - 0s 4us/step - loss: 0.5976 - accuracy: 0.6837
Epoch 14/18
20000/20000 [==============================] - 0s 4us/step - loss: 0.5971 - accuracy: 0.6841
Epoch 15/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5961 - accuracy: 0.6852
Epoch 16/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5957 - accuracy: 0.6857
Epoch 17/18
20000/20000 [==============================] - 0s 4us/step - loss: 0.5948 - accuracy: 0.6866
Epoch 18/18
20000/20000 [==============================] - 0s 4us/step - loss: 0.5943 - accuracy: 0.6862
5697/5697 [==============================] - 0s 18us/step
Epoch 1/19
20000/20000 [==============================] - 0s 10us/step - loss: 0.6837 - accuracy: 0.5784
Epoch 2/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6444 - accuracy: 0.6575
Epoch 3/19
20000/20000 [==============================] - 0s 6us/step - loss: 0.6272 - accuracy: 0.6740
Epoch 4/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6178 - accuracy: 0.6785
Epoch 5/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6129 - accuracy: 0.6814
Epoch 6/19
20000/20000 [==============================] - 0s 4us/step - loss: 0.6095 - accuracy: 0.6823
Epoch 7/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6074 - accuracy: 0.6833
Epoch 8/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6053 - accuracy: 0.6844
Epoch 9/19
20000/20000 [==============================] - 0s 6us/step - loss: 0.6040 - accuracy: 0.6844
Epoch 10/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6029 - accuracy: 0.6837
Epoch 11/19
20000/20000 [==============================] - 0s 4us/step - loss: 0.6019 - accuracy: 0.6846
Epoch 12/19
20000/20000 [==============================] - 0s 4us/step - loss: 0.6010 - accuracy: 0.6838
Epoch 13/19
20000/20000 [==============================] - 0s 4us/step - loss: 0.6002 - accuracy: 0.6849
Epoch 14/19
20000/20000 [==============================] - 0s 4us/step - loss: 0.5994 - accuracy: 0.6851
Epoch 15/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5989 - accuracy: 0.6852
Epoch 16/19
20000/20000 [==============================] - 0s 4us/step - loss: 0.5983 - accuracy: 0.6865
Epoch 17/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5974 - accuracy: 0.6864
Epoch 18/19
20000/20000 [==============================] - 0s 4us/step - loss: 0.5970 - accuracy: 0.6865
Epoch 19/19
20000/20000 [==============================] - 0s 4us/step - loss: 0.5964 - accuracy: 0.6865
5697/5697 [==============================] - 0s 18us/step
Epoch 1/20
20000/20000 [==============================] - 0s 11us/step - loss: 0.6826 - accuracy: 0.5999
Epoch 2/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6361 - accuracy: 0.6676
Epoch 3/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6219 - accuracy: 0.6772
Epoch 4/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6148 - accuracy: 0.6796
Epoch 5/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6101 - accuracy: 0.6808
Epoch 6/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6073 - accuracy: 0.6815
Epoch 7/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6046 - accuracy: 0.6830
Epoch 8/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6026 - accuracy: 0.6830
Epoch 9/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6010 - accuracy: 0.6844
Epoch 10/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5994 - accuracy: 0.6848
Epoch 11/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5987 - accuracy: 0.6858
Epoch 12/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5974 - accuracy: 0.6858
Epoch 13/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5964 - accuracy: 0.6859
Epoch 14/20
20000/20000 [==============================] - 0s 4us/step - loss: 0.5958 - accuracy: 0.6863
Epoch 15/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5946 - accuracy: 0.6874
Epoch 16/20
20000/20000 [==============================] - 0s 4us/step - loss: 0.5940 - accuracy: 0.6862
Epoch 17/20
20000/20000 [==============================] - 0s 4us/step - loss: 0.5936 - accuracy: 0.6877
Epoch 18/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5929 - accuracy: 0.6882
Epoch 19/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5924 - accuracy: 0.6882
Epoch 20/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5920 - accuracy: 0.6879
5697/5697 [==============================] - 0s 22us/step
Epoch 1/21
20000/20000 [==============================] - 0s 11us/step - loss: 0.6684 - accuracy: 0.6197
Epoch 2/21
20000/20000 [==============================] - 0s 4us/step - loss: 0.6326 - accuracy: 0.6718
Epoch 3/21
20000/20000 [==============================] - 0s 4us/step - loss: 0.6197 - accuracy: 0.6788
Epoch 4/21
20000/20000 [==============================] - 0s 6us/step - loss: 0.6134 - accuracy: 0.6817
Epoch 5/21
20000/20000 [==============================] - 0s 9us/step - loss: 0.6097 - accuracy: 0.6824
Epoch 6/21
20000/20000 [==============================] - 0s 8us/step - loss: 0.6075 - accuracy: 0.6827
Epoch 7/21
20000/20000 [==============================] - 0s 7us/step - loss: 0.6055 - accuracy: 0.6834
Epoch 8/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6043 - accuracy: 0.6834
Epoch 9/21
20000/20000 [==============================] - 0s 4us/step - loss: 0.6031 - accuracy: 0.6827
Epoch 10/21
20000/20000 [==============================] - 0s 4us/step - loss: 0.6022 - accuracy: 0.6848
Epoch 11/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6010 - accuracy: 0.6837
Epoch 12/21
20000/20000 [==============================] - 0s 7us/step - loss: 0.6004 - accuracy: 0.6849
Epoch 13/21
20000/20000 [==============================] - 0s 8us/step - loss: 0.5994 - accuracy: 0.6838
Epoch 14/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5987 - accuracy: 0.6849
Epoch 15/21
20000/20000 [==============================] - 0s 4us/step - loss: 0.5982 - accuracy: 0.6851
Epoch 16/21
20000/20000 [==============================] - 0s 4us/step - loss: 0.5975 - accuracy: 0.6862
Epoch 17/21
20000/20000 [==============================] - 0s 4us/step - loss: 0.5970 - accuracy: 0.6860
Epoch 18/21
20000/20000 [==============================] - 0s 4us/step - loss: 0.5964 - accuracy: 0.6865
Epoch 19/21
20000/20000 [==============================] - 0s 4us/step - loss: 0.5957 - accuracy: 0.6864
Epoch 20/21
20000/20000 [==============================] - 0s 4us/step - loss: 0.5954 - accuracy: 0.6863
Epoch 21/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5947 - accuracy: 0.6869
5697/5697 [==============================] - 0s 17us/step
Epoch 1/22
20000/20000 [==============================] - 0s 11us/step - loss: 0.6754 - accuracy: 0.5944
Epoch 2/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6348 - accuracy: 0.6633
Epoch 3/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6199 - accuracy: 0.6765
Epoch 4/22
20000/20000 [==============================] - 0s 6us/step - loss: 0.6122 - accuracy: 0.6806
Epoch 5/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6076 - accuracy: 0.6812
Epoch 6/22
20000/20000 [==============================] - 0s 4us/step - loss: 0.6050 - accuracy: 0.6827
Epoch 7/22
20000/20000 [==============================] - 0s 4us/step - loss: 0.6031 - accuracy: 0.6834
Epoch 8/22
20000/20000 [==============================] - 0s 4us/step - loss: 0.6017 - accuracy: 0.6835
Epoch 9/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6004 - accuracy: 0.6844
Epoch 10/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5997 - accuracy: 0.6846
Epoch 11/22
20000/20000 [==============================] - 0s 4us/step - loss: 0.5987 - accuracy: 0.6852
Epoch 12/22
20000/20000 [==============================] - 0s 4us/step - loss: 0.5976 - accuracy: 0.6856
Epoch 13/22
20000/20000 [==============================] - 0s 4us/step - loss: 0.5971 - accuracy: 0.6863
Epoch 14/22
20000/20000 [==============================] - 0s 4us/step - loss: 0.5965 - accuracy: 0.6855
Epoch 15/22
20000/20000 [==============================] - 0s 4us/step - loss: 0.5956 - accuracy: 0.6865
Epoch 16/22
20000/20000 [==============================] - 0s 4us/step - loss: 0.5952 - accuracy: 0.6860
Epoch 17/22
20000/20000 [==============================] - 0s 4us/step - loss: 0.5946 - accuracy: 0.6877
Epoch 18/22
20000/20000 [==============================] - 0s 4us/step - loss: 0.5939 - accuracy: 0.6870
Epoch 19/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5933 - accuracy: 0.6870
Epoch 20/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5928 - accuracy: 0.6877
Epoch 21/22
20000/20000 [==============================] - 0s 4us/step - loss: 0.5923 - accuracy: 0.6880
Epoch 22/22
20000/20000 [==============================] - 0s 4us/step - loss: 0.5919 - accuracy: 0.6875
5697/5697 [==============================] - 0s 19us/step
Epoch 1/23
20000/20000 [==============================] - 0s 10us/step - loss: 0.6904 - accuracy: 0.5842
Epoch 2/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6382 - accuracy: 0.6596
Epoch 3/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6221 - accuracy: 0.6743
Epoch 4/23
20000/20000 [==============================] - 0s 4us/step - loss: 0.6142 - accuracy: 0.6793
Epoch 5/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6099 - accuracy: 0.6798
Epoch 6/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6070 - accuracy: 0.6813
Epoch 7/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6048 - accuracy: 0.6831
Epoch 8/23
20000/20000 [==============================] - 0s 4us/step - loss: 0.6030 - accuracy: 0.6834
Epoch 9/23
20000/20000 [==============================] - 0s 4us/step - loss: 0.6015 - accuracy: 0.6840
Epoch 10/23
20000/20000 [==============================] - 0s 4us/step - loss: 0.6004 - accuracy: 0.6841
Epoch 11/23
20000/20000 [==============================] - 0s 4us/step - loss: 0.5993 - accuracy: 0.6856
Epoch 12/23
20000/20000 [==============================] - 0s 4us/step - loss: 0.5985 - accuracy: 0.6860
Epoch 13/23
20000/20000 [==============================] - 0s 4us/step - loss: 0.5975 - accuracy: 0.6861
Epoch 14/23
20000/20000 [==============================] - 0s 4us/step - loss: 0.5969 - accuracy: 0.6866
Epoch 15/23
20000/20000 [==============================] - 0s 4us/step - loss: 0.5958 - accuracy: 0.6863
Epoch 16/23
20000/20000 [==============================] - 0s 4us/step - loss: 0.5953 - accuracy: 0.6874
Epoch 17/23
20000/20000 [==============================] - 0s 4us/step - loss: 0.5946 - accuracy: 0.6873
Epoch 18/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5938 - accuracy: 0.6877
Epoch 19/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5932 - accuracy: 0.6887
Epoch 20/23
20000/20000 [==============================] - 0s 4us/step - loss: 0.5925 - accuracy: 0.6888
Epoch 21/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5920 - accuracy: 0.6881
Epoch 22/23
20000/20000 [==============================] - 0s 4us/step - loss: 0.5915 - accuracy: 0.6890
Epoch 23/23
20000/20000 [==============================] - 0s 4us/step - loss: 0.5908 - accuracy: 0.6895
5697/5697 [==============================] - 0s 19us/step
Epoch 1/24
20000/20000 [==============================] - 0s 11us/step - loss: 0.6955 - accuracy: 0.5757
Epoch 2/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6501 - accuracy: 0.6529
Epoch 3/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6305 - accuracy: 0.6730
Epoch 4/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6207 - accuracy: 0.6785
Epoch 5/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6146 - accuracy: 0.6800
Epoch 6/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6104 - accuracy: 0.6806
Epoch 7/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6077 - accuracy: 0.6818
Epoch 8/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6057 - accuracy: 0.6822
Epoch 9/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6039 - accuracy: 0.6834
Epoch 10/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6027 - accuracy: 0.6817
Epoch 11/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6013 - accuracy: 0.6823
Epoch 12/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6006 - accuracy: 0.6834
Epoch 13/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5995 - accuracy: 0.6837
Epoch 14/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5988 - accuracy: 0.6838
Epoch 15/24
20000/20000 [==============================] - 0s 4us/step - loss: 0.5980 - accuracy: 0.6840
Epoch 16/24
20000/20000 [==============================] - 0s 4us/step - loss: 0.5973 - accuracy: 0.6852
Epoch 17/24
20000/20000 [==============================] - 0s 4us/step - loss: 0.5966 - accuracy: 0.6849
Epoch 18/24
20000/20000 [==============================] - 0s 4us/step - loss: 0.5960 - accuracy: 0.6863
Epoch 19/24
20000/20000 [==============================] - 0s 4us/step - loss: 0.5954 - accuracy: 0.6861
Epoch 20/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5948 - accuracy: 0.6868
Epoch 21/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5944 - accuracy: 0.6866
Epoch 22/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5934 - accuracy: 0.6866
Epoch 23/24
20000/20000 [==============================] - 0s 4us/step - loss: 0.5932 - accuracy: 0.6867
Epoch 24/24
20000/20000 [==============================] - 0s 4us/step - loss: 0.5925 - accuracy: 0.6873
5697/5697 [==============================] - 0s 20us/step
Epoch 1/25
20000/20000 [==============================] - 0s 10us/step - loss: 0.6993 - accuracy: 0.5982
Epoch 2/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6361 - accuracy: 0.6682
Epoch 3/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6183 - accuracy: 0.6801
Epoch 4/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6117 - accuracy: 0.6823
Epoch 5/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6079 - accuracy: 0.6823
Epoch 6/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6058 - accuracy: 0.6823
Epoch 7/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6042 - accuracy: 0.6830
Epoch 8/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6028 - accuracy: 0.6837
Epoch 9/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6016 - accuracy: 0.6839
Epoch 10/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6006 - accuracy: 0.6841
Epoch 11/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5995 - accuracy: 0.6850
Epoch 12/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5986 - accuracy: 0.6855
Epoch 13/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5980 - accuracy: 0.6854
Epoch 14/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5974 - accuracy: 0.6853
Epoch 15/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5966 - accuracy: 0.6866
Epoch 16/25
20000/20000 [==============================] - 0s 4us/step - loss: 0.5960 - accuracy: 0.6856
Epoch 17/25
20000/20000 [==============================] - 0s 4us/step - loss: 0.5956 - accuracy: 0.6869
Epoch 18/25
20000/20000 [==============================] - 0s 4us/step - loss: 0.5949 - accuracy: 0.6871
Epoch 19/25
20000/20000 [==============================] - 0s 4us/step - loss: 0.5942 - accuracy: 0.6865
Epoch 20/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5938 - accuracy: 0.6871
Epoch 21/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5932 - accuracy: 0.6872
Epoch 22/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5930 - accuracy: 0.6876
Epoch 23/25
20000/20000 [==============================] - 0s 4us/step - loss: 0.5921 - accuracy: 0.6872
Epoch 24/25
20000/20000 [==============================] - 0s 4us/step - loss: 0.5918 - accuracy: 0.6877
Epoch 25/25
20000/20000 [==============================] - 0s 4us/step - loss: 0.5912 - accuracy: 0.6877
5697/5697 [==============================] - 0s 18us/step
Epoch 1/26
20000/20000 [==============================] - 0s 10us/step - loss: 0.6764 - accuracy: 0.5971
Epoch 2/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6326 - accuracy: 0.6683
Epoch 3/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6179 - accuracy: 0.6783
Epoch 4/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6118 - accuracy: 0.6794
Epoch 5/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6083 - accuracy: 0.6813
Epoch 6/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6060 - accuracy: 0.6815
Epoch 7/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6043 - accuracy: 0.6819
Epoch 8/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6029 - accuracy: 0.6821
Epoch 9/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6019 - accuracy: 0.6835
Epoch 10/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6009 - accuracy: 0.6829
Epoch 11/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5998 - accuracy: 0.6834
Epoch 12/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5990 - accuracy: 0.6834
Epoch 13/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5985 - accuracy: 0.6842
Epoch 14/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5977 - accuracy: 0.6837
Epoch 15/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5971 - accuracy: 0.6841
Epoch 16/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5963 - accuracy: 0.6843
Epoch 17/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5957 - accuracy: 0.6855
Epoch 18/26
20000/20000 [==============================] - 0s 4us/step - loss: 0.5953 - accuracy: 0.6859
Epoch 19/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5948 - accuracy: 0.6854
Epoch 20/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5941 - accuracy: 0.6856
Epoch 21/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5938 - accuracy: 0.6852
Epoch 22/26
20000/20000 [==============================] - 0s 4us/step - loss: 0.5935 - accuracy: 0.6862
Epoch 23/26
20000/20000 [==============================] - 0s 4us/step - loss: 0.5928 - accuracy: 0.6859
Epoch 24/26
20000/20000 [==============================] - 0s 4us/step - loss: 0.5924 - accuracy: 0.6863
Epoch 25/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5920 - accuracy: 0.6859
Epoch 26/26
20000/20000 [==============================] - 0s 4us/step - loss: 0.5916 - accuracy: 0.6862
5697/5697 [==============================] - 0s 19us/step
Epoch 1/27
20000/20000 [==============================] - 0s 10us/step - loss: 0.6765 - accuracy: 0.6127
Epoch 2/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6339 - accuracy: 0.6682
Epoch 3/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6193 - accuracy: 0.6769
Epoch 4/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6129 - accuracy: 0.6795
Epoch 5/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6092 - accuracy: 0.6805
Epoch 6/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6068 - accuracy: 0.6816
Epoch 7/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6055 - accuracy: 0.6813
Epoch 8/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6041 - accuracy: 0.6823
Epoch 9/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6032 - accuracy: 0.6819
Epoch 10/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6018 - accuracy: 0.6825
Epoch 11/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6013 - accuracy: 0.6831
Epoch 12/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6005 - accuracy: 0.6831
Epoch 13/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5998 - accuracy: 0.6841
Epoch 14/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5990 - accuracy: 0.6844
Epoch 15/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5982 - accuracy: 0.6835
Epoch 16/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5978 - accuracy: 0.6844
Epoch 17/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5971 - accuracy: 0.6845
Epoch 18/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5964 - accuracy: 0.6854
Epoch 19/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5958 - accuracy: 0.6847
Epoch 20/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5955 - accuracy: 0.6863
Epoch 21/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5948 - accuracy: 0.6863
Epoch 22/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5943 - accuracy: 0.6874
Epoch 23/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5938 - accuracy: 0.6876
Epoch 24/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5931 - accuracy: 0.6874
Epoch 25/27
20000/20000 [==============================] - 0s 4us/step - loss: 0.5930 - accuracy: 0.6873
Epoch 26/27
20000/20000 [==============================] - 0s 4us/step - loss: 0.5926 - accuracy: 0.6870
Epoch 27/27
20000/20000 [==============================] - 0s 4us/step - loss: 0.5918 - accuracy: 0.6869
5697/5697 [==============================] - 0s 18us/step
Epoch 1/28
20000/20000 [==============================] - 0s 10us/step - loss: 0.7035 - accuracy: 0.5911
Epoch 2/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6394 - accuracy: 0.6630
Epoch 3/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6221 - accuracy: 0.6773
Epoch 4/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6145 - accuracy: 0.6805
Epoch 5/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6100 - accuracy: 0.6825
Epoch 6/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6071 - accuracy: 0.6829
Epoch 7/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6052 - accuracy: 0.6840
Epoch 8/28
20000/20000 [==============================] - 0s 4us/step - loss: 0.6033 - accuracy: 0.6842
Epoch 9/28
20000/20000 [==============================] - 0s 4us/step - loss: 0.6020 - accuracy: 0.6845
Epoch 10/28
20000/20000 [==============================] - 0s 4us/step - loss: 0.6009 - accuracy: 0.6855
Epoch 11/28
20000/20000 [==============================] - 0s 4us/step - loss: 0.5998 - accuracy: 0.6855
Epoch 12/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5991 - accuracy: 0.6853
Epoch 13/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5980 - accuracy: 0.6860
Epoch 14/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5973 - accuracy: 0.6863
Epoch 15/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5964 - accuracy: 0.6862
Epoch 16/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5960 - accuracy: 0.6869
Epoch 17/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5950 - accuracy: 0.6856
Epoch 18/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5947 - accuracy: 0.6870
Epoch 19/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5940 - accuracy: 0.6867
Epoch 20/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5934 - accuracy: 0.6873
Epoch 21/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5929 - accuracy: 0.6874
Epoch 22/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5924 - accuracy: 0.6878
Epoch 23/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5920 - accuracy: 0.6880
Epoch 24/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5912 - accuracy: 0.6875
Epoch 25/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5909 - accuracy: 0.6887
Epoch 26/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5906 - accuracy: 0.6887
Epoch 27/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5901 - accuracy: 0.6884
Epoch 28/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5897 - accuracy: 0.6883
5697/5697 [==============================] - 0s 18us/step
Epoch 1/29
20000/20000 [==============================] - 0s 10us/step - loss: 0.6723 - accuracy: 0.6188
Epoch 2/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6346 - accuracy: 0.6694
Epoch 3/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6204 - accuracy: 0.6773
Epoch 4/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6132 - accuracy: 0.6804
Epoch 5/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6091 - accuracy: 0.6815
Epoch 6/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6066 - accuracy: 0.6823
Epoch 7/29
20000/20000 [==============================] - 0s 4us/step - loss: 0.6049 - accuracy: 0.6831
Epoch 8/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6035 - accuracy: 0.6826
Epoch 9/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6025 - accuracy: 0.6837
Epoch 10/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6013 - accuracy: 0.6837
Epoch 11/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6006 - accuracy: 0.6839
Epoch 12/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5996 - accuracy: 0.6838
Epoch 13/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5988 - accuracy: 0.6840
Epoch 14/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5981 - accuracy: 0.6844
Epoch 15/29
20000/20000 [==============================] - 0s 4us/step - loss: 0.5974 - accuracy: 0.6850
Epoch 16/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5970 - accuracy: 0.6850
Epoch 17/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5964 - accuracy: 0.6847
Epoch 18/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5960 - accuracy: 0.6847
Epoch 19/29
20000/20000 [==============================] - 0s 4us/step - loss: 0.5955 - accuracy: 0.6846
Epoch 20/29
20000/20000 [==============================] - 0s 4us/step - loss: 0.5951 - accuracy: 0.6849
Epoch 21/29
20000/20000 [==============================] - 0s 4us/step - loss: 0.5946 - accuracy: 0.6859
Epoch 22/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5939 - accuracy: 0.6862
Epoch 23/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5936 - accuracy: 0.6857
Epoch 24/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5929 - accuracy: 0.6866
Epoch 25/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5927 - accuracy: 0.6870
Epoch 26/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5923 - accuracy: 0.6861
Epoch 27/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5916 - accuracy: 0.6867
Epoch 28/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5914 - accuracy: 0.6870
Epoch 29/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5907 - accuracy: 0.6869
5697/5697 [==============================] - 0s 18us/step
Epoch 1/30
20000/20000 [==============================] - 0s 10us/step - loss: 0.6708 - accuracy: 0.6033
Epoch 2/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6345 - accuracy: 0.6660
Epoch 3/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6193 - accuracy: 0.6784
Epoch 4/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6122 - accuracy: 0.6809
Epoch 5/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6083 - accuracy: 0.6815
Epoch 6/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6061 - accuracy: 0.6811
Epoch 7/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6042 - accuracy: 0.6830
Epoch 8/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6031 - accuracy: 0.6841
Epoch 9/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6016 - accuracy: 0.6841
Epoch 10/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6010 - accuracy: 0.6849
Epoch 11/30
20000/20000 [==============================] - 0s 4us/step - loss: 0.6000 - accuracy: 0.6851
Epoch 12/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5991 - accuracy: 0.6854
Epoch 13/30
20000/20000 [==============================] - 0s 4us/step - loss: 0.5986 - accuracy: 0.6860
Epoch 14/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5981 - accuracy: 0.6862
Epoch 15/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5975 - accuracy: 0.6867
Epoch 16/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5967 - accuracy: 0.6867
Epoch 17/30
20000/20000 [==============================] - 0s 4us/step - loss: 0.5963 - accuracy: 0.6866
Epoch 18/30
20000/20000 [==============================] - 0s 4us/step - loss: 0.5958 - accuracy: 0.6864
Epoch 19/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5954 - accuracy: 0.6877
Epoch 20/30
20000/20000 [==============================] - 0s 4us/step - loss: 0.5948 - accuracy: 0.6870
Epoch 21/30
20000/20000 [==============================] - 0s 4us/step - loss: 0.5944 - accuracy: 0.6872
Epoch 22/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5937 - accuracy: 0.6875
Epoch 23/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5934 - accuracy: 0.6881
Epoch 24/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5930 - accuracy: 0.6878
Epoch 25/30
20000/20000 [==============================] - 0s 4us/step - loss: 0.5928 - accuracy: 0.6882
Epoch 26/30
20000/20000 [==============================] - 0s 4us/step - loss: 0.5924 - accuracy: 0.6884
Epoch 27/30
20000/20000 [==============================] - 0s 4us/step - loss: 0.5919 - accuracy: 0.6878
Epoch 28/30
20000/20000 [==============================] - 0s 4us/step - loss: 0.5915 - accuracy: 0.6884
Epoch 29/30
20000/20000 [==============================] - 0s 4us/step - loss: 0.5911 - accuracy: 0.6890
Epoch 30/30
20000/20000 [==============================] - 0s 4us/step - loss: 0.5908 - accuracy: 0.6887
5697/5697 [==============================] - 0s 20us/step
Epoch 1/7
20000/20000 [==============================] - 0s 11us/step - loss: 0.6760 - accuracy: 0.5898
Epoch 2/7
20000/20000 [==============================] - 0s 5us/step - loss: 0.6324 - accuracy: 0.6702
Epoch 3/7
20000/20000 [==============================] - 0s 5us/step - loss: 0.6174 - accuracy: 0.6781
Epoch 4/7
20000/20000 [==============================] - 0s 5us/step - loss: 0.6111 - accuracy: 0.6812
Epoch 5/7
20000/20000 [==============================] - 0s 5us/step - loss: 0.6075 - accuracy: 0.6817
Epoch 6/7
20000/20000 [==============================] - 0s 5us/step - loss: 0.6050 - accuracy: 0.6819
Epoch 7/7
20000/20000 [==============================] - 0s 5us/step - loss: 0.6031 - accuracy: 0.6834
5697/5697 [==============================] - 0s 19us/step
Epoch 1/8
20000/20000 [==============================] - 0s 11us/step - loss: 0.6743 - accuracy: 0.6076
Epoch 2/8
20000/20000 [==============================] - 0s 5us/step - loss: 0.6323 - accuracy: 0.6717
Epoch 3/8
20000/20000 [==============================] - 0s 5us/step - loss: 0.6197 - accuracy: 0.6766
Epoch 4/8
20000/20000 [==============================] - 0s 5us/step - loss: 0.6133 - accuracy: 0.6801
Epoch 5/8
20000/20000 [==============================] - 0s 6us/step - loss: 0.6095 - accuracy: 0.6817
Epoch 6/8
20000/20000 [==============================] - 0s 5us/step - loss: 0.6071 - accuracy: 0.6811
Epoch 7/8
20000/20000 [==============================] - 0s 5us/step - loss: 0.6049 - accuracy: 0.6826
Epoch 8/8
20000/20000 [==============================] - 0s 4us/step - loss: 0.6035 - accuracy: 0.6836
5697/5697 [==============================] - 0s 18us/step
Epoch 1/9
20000/20000 [==============================] - 0s 15us/step - loss: 0.6767 - accuracy: 0.5937
Epoch 2/9
20000/20000 [==============================] - 0s 5us/step - loss: 0.6341 - accuracy: 0.6676
Epoch 3/9
20000/20000 [==============================] - 0s 5us/step - loss: 0.6183 - accuracy: 0.6786
Epoch 4/9
20000/20000 [==============================] - 0s 7us/step - loss: 0.6108 - accuracy: 0.6808
Epoch 5/9
20000/20000 [==============================] - 0s 8us/step - loss: 0.6068 - accuracy: 0.6802
Epoch 6/9
20000/20000 [==============================] - 0s 7us/step - loss: 0.6041 - accuracy: 0.6816
Epoch 7/9
20000/20000 [==============================] - 0s 6us/step - loss: 0.6024 - accuracy: 0.6816
Epoch 8/9
20000/20000 [==============================] - 0s 5us/step - loss: 0.6010 - accuracy: 0.6824
Epoch 9/9
20000/20000 [==============================] - 0s 6us/step - loss: 0.5996 - accuracy: 0.6829
5697/5697 [==============================] - 0s 29us/step
Epoch 1/10
20000/20000 [==============================] - 0s 16us/step - loss: 0.6640 - accuracy: 0.6199
Epoch 2/10
20000/20000 [==============================] - 0s 6us/step - loss: 0.6297 - accuracy: 0.6719
Epoch 3/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.6170 - accuracy: 0.6798
Epoch 4/10
20000/20000 [==============================] - 0s 6us/step - loss: 0.6107 - accuracy: 0.6800
Epoch 5/10
20000/20000 [==============================] - 0s 8us/step - loss: 0.6067 - accuracy: 0.6819
Epoch 6/10
20000/20000 [==============================] - 0s 7us/step - loss: 0.6047 - accuracy: 0.6818
Epoch 7/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.6026 - accuracy: 0.6824
Epoch 8/10
20000/20000 [==============================] - 0s 6us/step - loss: 0.6015 - accuracy: 0.6830: 0s - loss: 0.6015 - accuracy: 0.68
Epoch 9/10
20000/20000 [==============================] - 0s 6us/step - loss: 0.6002 - accuracy: 0.6834
Epoch 10/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.5994 - accuracy: 0.6836
5697/5697 [==============================] - 0s 16us/step
Epoch 1/11
20000/20000 [==============================] - 0s 11us/step - loss: 0.6912 - accuracy: 0.5774
Epoch 2/11
20000/20000 [==============================] - 0s 5us/step - loss: 0.6360 - accuracy: 0.6661
Epoch 3/11
20000/20000 [==============================] - 0s 6us/step - loss: 0.6199 - accuracy: 0.6779
Epoch 4/11
20000/20000 [==============================] - 0s 5us/step - loss: 0.6123 - accuracy: 0.6802
Epoch 5/11
20000/20000 [==============================] - 0s 10us/step - loss: 0.6081 - accuracy: 0.6805
Epoch 6/11
20000/20000 [==============================] - 0s 5us/step - loss: 0.6055 - accuracy: 0.6817
Epoch 7/11
20000/20000 [==============================] - 0s 5us/step - loss: 0.6030 - accuracy: 0.6825
Epoch 8/11
20000/20000 [==============================] - 0s 5us/step - loss: 0.6018 - accuracy: 0.6835
Epoch 9/11
20000/20000 [==============================] - 0s 4us/step - loss: 0.6008 - accuracy: 0.6835
Epoch 10/11
20000/20000 [==============================] - 0s 4us/step - loss: 0.5993 - accuracy: 0.6844
Epoch 11/11
20000/20000 [==============================] - 0s 4us/step - loss: 0.5984 - accuracy: 0.6844
5697/5697 [==============================] - 0s 20us/step
Epoch 1/12
20000/20000 [==============================] - 0s 15us/step - loss: 0.6765 - accuracy: 0.6055
Epoch 2/12
20000/20000 [==============================] - 0s 8us/step - loss: 0.6288 - accuracy: 0.6694
Epoch 3/12
20000/20000 [==============================] - 0s 8us/step - loss: 0.6155 - accuracy: 0.6805
Epoch 4/12
20000/20000 [==============================] - 0s 7us/step - loss: 0.6102 - accuracy: 0.6815
Epoch 5/12
20000/20000 [==============================] - 0s 8us/step - loss: 0.6076 - accuracy: 0.6827
Epoch 6/12
20000/20000 [==============================] - 0s 8us/step - loss: 0.6053 - accuracy: 0.6817
Epoch 7/12
20000/20000 [==============================] - 0s 7us/step - loss: 0.6036 - accuracy: 0.6828
Epoch 8/12
20000/20000 [==============================] - 0s 7us/step - loss: 0.6026 - accuracy: 0.6837
Epoch 9/12
20000/20000 [==============================] - 0s 7us/step - loss: 0.6015 - accuracy: 0.6844
Epoch 10/12
20000/20000 [==============================] - 0s 7us/step - loss: 0.6003 - accuracy: 0.6841
Epoch 11/12
20000/20000 [==============================] - 0s 7us/step - loss: 0.5996 - accuracy: 0.6848
Epoch 12/12
20000/20000 [==============================] - 0s 6us/step - loss: 0.5986 - accuracy: 0.6856
5697/5697 [==============================] - 0s 18us/step
Epoch 1/13
20000/20000 [==============================] - 0s 13us/step - loss: 0.6709 - accuracy: 0.6080
Epoch 2/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6307 - accuracy: 0.6741
Epoch 3/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6174 - accuracy: 0.6799
Epoch 4/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6113 - accuracy: 0.6812
Epoch 5/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6079 - accuracy: 0.6815
Epoch 6/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6059 - accuracy: 0.6826
Epoch 7/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6044 - accuracy: 0.6836
Epoch 8/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6033 - accuracy: 0.6840
Epoch 9/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6021 - accuracy: 0.6830
Epoch 10/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6010 - accuracy: 0.6846
Epoch 11/13
20000/20000 [==============================] - 0s 4us/step - loss: 0.6001 - accuracy: 0.6849
Epoch 12/13
20000/20000 [==============================] - 0s 4us/step - loss: 0.5998 - accuracy: 0.6850
Epoch 13/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.5986 - accuracy: 0.6848
5697/5697 [==============================] - 0s 18us/step
Epoch 1/14
20000/20000 [==============================] - 0s 12us/step - loss: 0.6625 - accuracy: 0.6259
Epoch 2/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6259 - accuracy: 0.6738
Epoch 3/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6147 - accuracy: 0.6798
Epoch 4/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6097 - accuracy: 0.6819
Epoch 5/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6069 - accuracy: 0.6819
Epoch 6/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6048 - accuracy: 0.6824
Epoch 7/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6033 - accuracy: 0.6831
Epoch 8/14
20000/20000 [==============================] - 0s 7us/step - loss: 0.6015 - accuracy: 0.6834
Epoch 9/14
20000/20000 [==============================] - 0s 6us/step - loss: 0.6006 - accuracy: 0.6848
Epoch 10/14
20000/20000 [==============================] - 0s 6us/step - loss: 0.5997 - accuracy: 0.6836
Epoch 11/14
20000/20000 [==============================] - 0s 6us/step - loss: 0.5986 - accuracy: 0.6860
Epoch 12/14
20000/20000 [==============================] - 0s 6us/step - loss: 0.5979 - accuracy: 0.6855
Epoch 13/14
20000/20000 [==============================] - 0s 7us/step - loss: 0.5969 - accuracy: 0.6861: 0s - loss: 0.5939 - accuracy: 0.
Epoch 14/14
20000/20000 [==============================] - 0s 7us/step - loss: 0.5963 - accuracy: 0.6866
5697/5697 [==============================] - 0s 28us/step
Epoch 1/15
20000/20000 [==============================] - 0s 11us/step - loss: 0.6626 - accuracy: 0.6183
Epoch 2/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6278 - accuracy: 0.6708
Epoch 3/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6150 - accuracy: 0.6790
Epoch 4/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6092 - accuracy: 0.6805
Epoch 5/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6058 - accuracy: 0.6819
Epoch 6/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6043 - accuracy: 0.6837
Epoch 7/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6025 - accuracy: 0.6829
Epoch 8/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6013 - accuracy: 0.6837
Epoch 9/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6004 - accuracy: 0.6840
Epoch 10/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.5991 - accuracy: 0.6848
Epoch 11/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.5984 - accuracy: 0.6848
Epoch 12/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.5976 - accuracy: 0.6852
Epoch 13/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.5971 - accuracy: 0.6855
Epoch 14/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.5962 - accuracy: 0.6862
Epoch 15/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.5958 - accuracy: 0.6861
5697/5697 [==============================] - 0s 20us/step
Epoch 1/16
20000/20000 [==============================] - 0s 11us/step - loss: 0.6662 - accuracy: 0.6111
Epoch 2/16
20000/20000 [==============================] - 0s 6us/step - loss: 0.6307 - accuracy: 0.6709
Epoch 3/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6172 - accuracy: 0.6808
Epoch 4/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6111 - accuracy: 0.6822
Epoch 5/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6075 - accuracy: 0.6837
Epoch 6/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6053 - accuracy: 0.6831
Epoch 7/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6034 - accuracy: 0.6833
Epoch 8/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6017 - accuracy: 0.6837
Epoch 9/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6006 - accuracy: 0.6842
Epoch 10/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.5996 - accuracy: 0.6843
Epoch 11/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.5983 - accuracy: 0.6848
Epoch 12/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.5976 - accuracy: 0.6855
Epoch 13/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.5970 - accuracy: 0.6851
Epoch 14/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.5961 - accuracy: 0.6855
Epoch 15/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.5955 - accuracy: 0.6850
Epoch 16/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.5943 - accuracy: 0.6859
5697/5697 [==============================] - 0s 19us/step
Epoch 1/17
20000/20000 [==============================] - 0s 12us/step - loss: 0.6690 - accuracy: 0.6140
Epoch 2/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6281 - accuracy: 0.6707
Epoch 3/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6166 - accuracy: 0.6786
Epoch 4/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6111 - accuracy: 0.6814
Epoch 5/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6076 - accuracy: 0.6820
Epoch 6/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6057 - accuracy: 0.6824
Epoch 7/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6038 - accuracy: 0.6831
Epoch 8/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6025 - accuracy: 0.6837
Epoch 9/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6012 - accuracy: 0.6844
Epoch 10/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6002 - accuracy: 0.6843
Epoch 11/17
20000/20000 [==============================] - 0s 6us/step - loss: 0.5995 - accuracy: 0.6852
Epoch 12/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.5985 - accuracy: 0.6852
Epoch 13/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.5978 - accuracy: 0.6849
Epoch 14/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.5971 - accuracy: 0.6858
Epoch 15/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.5964 - accuracy: 0.6863
Epoch 16/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.5958 - accuracy: 0.6861
Epoch 17/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.5951 - accuracy: 0.6866
5697/5697 [==============================] - 0s 20us/step
Epoch 1/18
20000/20000 [==============================] - 0s 12us/step - loss: 0.6776 - accuracy: 0.5813
Epoch 2/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.6339 - accuracy: 0.6703
Epoch 3/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6197 - accuracy: 0.6790
Epoch 4/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6130 - accuracy: 0.6800
Epoch 5/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6095 - accuracy: 0.6818
Epoch 6/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6073 - accuracy: 0.6821
Epoch 7/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6050 - accuracy: 0.6823
Epoch 8/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6035 - accuracy: 0.6830
Epoch 9/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6022 - accuracy: 0.6837
Epoch 10/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.6013 - accuracy: 0.6841
Epoch 11/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.5999 - accuracy: 0.6850
Epoch 12/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.5993 - accuracy: 0.6850
Epoch 13/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5981 - accuracy: 0.6852
Epoch 14/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5973 - accuracy: 0.6859
Epoch 15/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5966 - accuracy: 0.6862
Epoch 16/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5959 - accuracy: 0.6866
Epoch 17/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5952 - accuracy: 0.6862
Epoch 18/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5945 - accuracy: 0.6873
5697/5697 [==============================] - 0s 18us/step
Epoch 1/19
20000/20000 [==============================] - 0s 12us/step - loss: 0.6604 - accuracy: 0.6241
Epoch 2/19
20000/20000 [==============================] - 0s 6us/step - loss: 0.6264 - accuracy: 0.6755
Epoch 3/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6148 - accuracy: 0.6805
Epoch 4/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6101 - accuracy: 0.6816
Epoch 5/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6073 - accuracy: 0.6830
Epoch 6/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6055 - accuracy: 0.6833
Epoch 7/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6039 - accuracy: 0.6844
Epoch 8/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6029 - accuracy: 0.6851
Epoch 9/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6016 - accuracy: 0.6850
Epoch 10/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6006 - accuracy: 0.6853
Epoch 11/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5997 - accuracy: 0.6852
Epoch 12/19
20000/20000 [==============================] - 0s 6us/step - loss: 0.5988 - accuracy: 0.6863
Epoch 13/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5982 - accuracy: 0.6869
Epoch 14/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5978 - accuracy: 0.6866
Epoch 15/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5972 - accuracy: 0.6868
Epoch 16/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5961 - accuracy: 0.6873
Epoch 17/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5957 - accuracy: 0.6876
Epoch 18/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5951 - accuracy: 0.6867
Epoch 19/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5947 - accuracy: 0.6872
5697/5697 [==============================] - 0s 18us/step
Epoch 1/20
20000/20000 [==============================] - 0s 11us/step - loss: 0.6824 - accuracy: 0.5859
Epoch 2/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6357 - accuracy: 0.6707
Epoch 3/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6205 - accuracy: 0.6796
Epoch 4/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6136 - accuracy: 0.6822
Epoch 5/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6093 - accuracy: 0.6827
Epoch 6/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6066 - accuracy: 0.6826
Epoch 7/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6045 - accuracy: 0.6836
Epoch 8/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6032 - accuracy: 0.6844
Epoch 9/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6021 - accuracy: 0.6848
Epoch 10/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6007 - accuracy: 0.6847
Epoch 11/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5998 - accuracy: 0.6855
Epoch 12/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5987 - accuracy: 0.6854
Epoch 13/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5980 - accuracy: 0.6864
Epoch 14/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5972 - accuracy: 0.6868
Epoch 15/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5965 - accuracy: 0.6867
Epoch 16/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5960 - accuracy: 0.6870
Epoch 17/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5957 - accuracy: 0.6866
Epoch 18/20
20000/20000 [==============================] - 0s 6us/step - loss: 0.5949 - accuracy: 0.6863
Epoch 19/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5944 - accuracy: 0.6872
Epoch 20/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5939 - accuracy: 0.6877
5697/5697 [==============================] - 0s 19us/step
Epoch 1/21
20000/20000 [==============================] - 0s 12us/step - loss: 0.6735 - accuracy: 0.5989
Epoch 2/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6308 - accuracy: 0.6733
Epoch 3/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6178 - accuracy: 0.6818
Epoch 4/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6117 - accuracy: 0.6823
Epoch 5/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6080 - accuracy: 0.6833
Epoch 6/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6057 - accuracy: 0.6847
Epoch 7/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6039 - accuracy: 0.6842
Epoch 8/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6027 - accuracy: 0.6844
Epoch 9/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6013 - accuracy: 0.6844
Epoch 10/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6005 - accuracy: 0.6844
Epoch 11/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5994 - accuracy: 0.6847
Epoch 12/21
20000/20000 [==============================] - 0s 6us/step - loss: 0.5985 - accuracy: 0.6854
Epoch 13/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5980 - accuracy: 0.6856
Epoch 14/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5974 - accuracy: 0.6855
Epoch 15/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5964 - accuracy: 0.6850
Epoch 16/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5959 - accuracy: 0.6859
Epoch 17/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5954 - accuracy: 0.6858
Epoch 18/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5950 - accuracy: 0.6862
Epoch 19/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5944 - accuracy: 0.6859
Epoch 20/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5938 - accuracy: 0.6875
Epoch 21/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5935 - accuracy: 0.6872
5697/5697 [==============================] - 0s 20us/step
Epoch 1/22
20000/20000 [==============================] - 0s 12us/step - loss: 0.6770 - accuracy: 0.6019
Epoch 2/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6303 - accuracy: 0.6753
Epoch 3/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6173 - accuracy: 0.6804
Epoch 4/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6111 - accuracy: 0.6814
Epoch 5/22
20000/20000 [==============================] - 0s 6us/step - loss: 0.6079 - accuracy: 0.6820
Epoch 6/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6052 - accuracy: 0.6822
Epoch 7/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6030 - accuracy: 0.6824
Epoch 8/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6016 - accuracy: 0.6827
Epoch 9/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6003 - accuracy: 0.6844
Epoch 10/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5990 - accuracy: 0.6847
Epoch 11/22
20000/20000 [==============================] - 0s 6us/step - loss: 0.5976 - accuracy: 0.6852
Epoch 12/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5974 - accuracy: 0.6843
Epoch 13/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5961 - accuracy: 0.6856
Epoch 14/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5950 - accuracy: 0.6859
Epoch 15/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5947 - accuracy: 0.6862
Epoch 16/22
20000/20000 [==============================] - 0s 4us/step - loss: 0.5939 - accuracy: 0.6869
Epoch 17/22
20000/20000 [==============================] - 0s 4us/step - loss: 0.5928 - accuracy: 0.6867
Epoch 18/22
20000/20000 [==============================] - 0s 4us/step - loss: 0.5921 - accuracy: 0.6881
Epoch 19/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5916 - accuracy: 0.6867
Epoch 20/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5914 - accuracy: 0.6871
Epoch 21/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5904 - accuracy: 0.6879
Epoch 22/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5900 - accuracy: 0.6877
5697/5697 [==============================] - 0s 23us/step
Epoch 1/23
20000/20000 [==============================] - 0s 13us/step - loss: 0.6786 - accuracy: 0.6008
Epoch 2/23
20000/20000 [==============================] - 0s 7us/step - loss: 0.6332 - accuracy: 0.6719
Epoch 3/23
20000/20000 [==============================] - 0s 7us/step - loss: 0.6184 - accuracy: 0.6769
Epoch 4/23
20000/20000 [==============================] - 0s 6us/step - loss: 0.6119 - accuracy: 0.6804
Epoch 5/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6081 - accuracy: 0.6815
Epoch 6/23
20000/20000 [==============================] - 0s 7us/step - loss: 0.6056 - accuracy: 0.6817
Epoch 7/23
20000/20000 [==============================] - 0s 8us/step - loss: 0.6037 - accuracy: 0.6827
Epoch 8/23
20000/20000 [==============================] - 0s 8us/step - loss: 0.6021 - accuracy: 0.6830
Epoch 9/23
20000/20000 [==============================] - 0s 6us/step - loss: 0.6009 - accuracy: 0.6846
Epoch 10/23
20000/20000 [==============================] - 0s 6us/step - loss: 0.5998 - accuracy: 0.6841
Epoch 11/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5989 - accuracy: 0.6854
Epoch 12/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5980 - accuracy: 0.6858
Epoch 13/23
20000/20000 [==============================] - 0s 6us/step - loss: 0.5971 - accuracy: 0.6854
Epoch 14/23
20000/20000 [==============================] - 0s 7us/step - loss: 0.5963 - accuracy: 0.6849
Epoch 15/23
20000/20000 [==============================] - 0s 6us/step - loss: 0.5955 - accuracy: 0.6852
Epoch 16/23
20000/20000 [==============================] - 0s 8us/step - loss: 0.5949 - accuracy: 0.6865
Epoch 17/23
20000/20000 [==============================] - 0s 10us/step - loss: 0.5945 - accuracy: 0.6863
Epoch 18/23
20000/20000 [==============================] - 0s 7us/step - loss: 0.5937 - accuracy: 0.6862
Epoch 19/23
20000/20000 [==============================] - 0s 6us/step - loss: 0.5930 - accuracy: 0.6867
Epoch 20/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5928 - accuracy: 0.6874
Epoch 21/23
20000/20000 [==============================] - 0s 6us/step - loss: 0.5920 - accuracy: 0.6876
Epoch 22/23
20000/20000 [==============================] - 0s 6us/step - loss: 0.5917 - accuracy: 0.6884
Epoch 23/23
20000/20000 [==============================] - 0s 6us/step - loss: 0.5908 - accuracy: 0.6884
5697/5697 [==============================] - 0s 25us/step
Epoch 1/24
20000/20000 [==============================] - 0s 12us/step - loss: 0.6822 - accuracy: 0.5749
Epoch 2/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6345 - accuracy: 0.6677
Epoch 3/24
20000/20000 [==============================] - 0s 6us/step - loss: 0.6188 - accuracy: 0.6800
Epoch 4/24
20000/20000 [==============================] - 0s 8us/step - loss: 0.6120 - accuracy: 0.6821
Epoch 5/24
20000/20000 [==============================] - 0s 7us/step - loss: 0.6089 - accuracy: 0.6827
Epoch 6/24
20000/20000 [==============================] - 0s 6us/step - loss: 0.6068 - accuracy: 0.6831
Epoch 7/24
20000/20000 [==============================] - 0s 6us/step - loss: 0.6051 - accuracy: 0.6844
Epoch 8/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6035 - accuracy: 0.6843
Epoch 9/24
20000/20000 [==============================] - 0s 4us/step - loss: 0.6023 - accuracy: 0.6834
Epoch 10/24
20000/20000 [==============================] - 0s 4us/step - loss: 0.6010 - accuracy: 0.6851
Epoch 11/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6000 - accuracy: 0.6858
Epoch 12/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5989 - accuracy: 0.6853
Epoch 13/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5982 - accuracy: 0.6862
Epoch 14/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5974 - accuracy: 0.6862
Epoch 15/24
20000/20000 [==============================] - 0s 4us/step - loss: 0.5967 - accuracy: 0.6865
Epoch 16/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5958 - accuracy: 0.6877
Epoch 17/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5954 - accuracy: 0.6870
Epoch 18/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5946 - accuracy: 0.6869
Epoch 19/24
20000/20000 [==============================] - 0s 4us/step - loss: 0.5940 - accuracy: 0.6881
Epoch 20/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5933 - accuracy: 0.6888
Epoch 21/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5930 - accuracy: 0.6877
Epoch 22/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5924 - accuracy: 0.6883
Epoch 23/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5918 - accuracy: 0.6892
Epoch 24/24
20000/20000 [==============================] - 0s 4us/step - loss: 0.5913 - accuracy: 0.6890
5697/5697 [==============================] - 0s 19us/step
Epoch 1/25
20000/20000 [==============================] - 0s 12us/step - loss: 0.6775 - accuracy: 0.5995
Epoch 2/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6316 - accuracy: 0.6700
Epoch 3/25
20000/20000 [==============================] - 0s 7us/step - loss: 0.6179 - accuracy: 0.6798
Epoch 4/25
20000/20000 [==============================] - 0s 10us/step - loss: 0.6114 - accuracy: 0.6820
Epoch 5/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.6081 - accuracy: 0.6820
Epoch 6/25
20000/20000 [==============================] - 0s 4us/step - loss: 0.6053 - accuracy: 0.6829
Epoch 7/25
20000/20000 [==============================] - 0s 4us/step - loss: 0.6039 - accuracy: 0.6831
Epoch 8/25
20000/20000 [==============================] - 0s 4us/step - loss: 0.6019 - accuracy: 0.6831
Epoch 9/25
20000/20000 [==============================] - 0s 4us/step - loss: 0.6006 - accuracy: 0.6837
Epoch 10/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5997 - accuracy: 0.6837
Epoch 11/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5982 - accuracy: 0.6841
Epoch 12/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.5974 - accuracy: 0.6846
Epoch 13/25
20000/20000 [==============================] - 0s 9us/step - loss: 0.5966 - accuracy: 0.6854
Epoch 14/25
20000/20000 [==============================] - 0s 8us/step - loss: 0.5958 - accuracy: 0.6846
Epoch 15/25
20000/20000 [==============================] - 0s 8us/step - loss: 0.5953 - accuracy: 0.6862
Epoch 16/25
20000/20000 [==============================] - 0s 7us/step - loss: 0.5943 - accuracy: 0.6854
Epoch 17/25
20000/20000 [==============================] - 0s 8us/step - loss: 0.5937 - accuracy: 0.6851
Epoch 18/25
20000/20000 [==============================] - 0s 7us/step - loss: 0.5929 - accuracy: 0.6867
Epoch 19/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.5925 - accuracy: 0.6863
Epoch 20/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.5917 - accuracy: 0.6867
Epoch 21/25
20000/20000 [==============================] - 0s 7us/step - loss: 0.5914 - accuracy: 0.6867
Epoch 22/25
20000/20000 [==============================] - 0s 8us/step - loss: 0.5908 - accuracy: 0.6877
Epoch 23/25
20000/20000 [==============================] - 0s 7us/step - loss: 0.5901 - accuracy: 0.6884
Epoch 24/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.5895 - accuracy: 0.6883
Epoch 25/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5891 - accuracy: 0.6880
5697/5697 [==============================] - 0s 20us/step
Epoch 1/26
20000/20000 [==============================] - 0s 11us/step - loss: 0.6660 - accuracy: 0.6197
Epoch 2/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6306 - accuracy: 0.6691
Epoch 3/26
20000/20000 [==============================] - 0s 6us/step - loss: 0.6177 - accuracy: 0.6780
Epoch 4/26
20000/20000 [==============================] - 0s 6us/step - loss: 0.6119 - accuracy: 0.6806
Epoch 5/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6088 - accuracy: 0.6803
Epoch 6/26
20000/20000 [==============================] - 0s 4us/step - loss: 0.6067 - accuracy: 0.6823
Epoch 7/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6051 - accuracy: 0.6826
Epoch 8/26
20000/20000 [==============================] - 0s 4us/step - loss: 0.6036 - accuracy: 0.6829
Epoch 9/26
20000/20000 [==============================] - 0s 4us/step - loss: 0.6022 - accuracy: 0.6844
Epoch 10/26
20000/20000 [==============================] - 0s 4us/step - loss: 0.6012 - accuracy: 0.6838
Epoch 11/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6005 - accuracy: 0.6842
Epoch 12/26
20000/20000 [==============================] - 0s 4us/step - loss: 0.5991 - accuracy: 0.6843
Epoch 13/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5984 - accuracy: 0.6851
Epoch 14/26
20000/20000 [==============================] - 0s 4us/step - loss: 0.5977 - accuracy: 0.6856
Epoch 15/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5970 - accuracy: 0.6852
Epoch 16/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5962 - accuracy: 0.6855
Epoch 17/26
20000/20000 [==============================] - 0s 4us/step - loss: 0.5957 - accuracy: 0.6865
Epoch 18/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5952 - accuracy: 0.6855
Epoch 19/26
20000/20000 [==============================] - 0s 4us/step - loss: 0.5947 - accuracy: 0.6863
Epoch 20/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5940 - accuracy: 0.6859
Epoch 21/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5935 - accuracy: 0.6866
Epoch 22/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5928 - accuracy: 0.6863
Epoch 23/26
20000/20000 [==============================] - 0s 4us/step - loss: 0.5922 - accuracy: 0.6870
Epoch 24/26
20000/20000 [==============================] - 0s 4us/step - loss: 0.5920 - accuracy: 0.6876
Epoch 25/26
20000/20000 [==============================] - 0s 4us/step - loss: 0.5917 - accuracy: 0.6880
Epoch 26/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5910 - accuracy: 0.6881
5697/5697 [==============================] - 0s 18us/step
Epoch 1/27
20000/20000 [==============================] - 0s 11us/step - loss: 0.6789 - accuracy: 0.5942
Epoch 2/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6341 - accuracy: 0.6607
Epoch 3/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6201 - accuracy: 0.6761
Epoch 4/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6128 - accuracy: 0.6819
Epoch 5/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6088 - accuracy: 0.6812
Epoch 6/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6061 - accuracy: 0.6837
Epoch 7/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6039 - accuracy: 0.6834
Epoch 8/27
20000/20000 [==============================] - 0s 6us/step - loss: 0.6025 - accuracy: 0.6837
Epoch 9/27
20000/20000 [==============================] - 0s 4us/step - loss: 0.6006 - accuracy: 0.6844
Epoch 10/27
20000/20000 [==============================] - 0s 4us/step - loss: 0.6000 - accuracy: 0.6847
Epoch 11/27
20000/20000 [==============================] - 0s 4us/step - loss: 0.5990 - accuracy: 0.6853
Epoch 12/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5979 - accuracy: 0.6859
Epoch 13/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5973 - accuracy: 0.6856
Epoch 14/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5966 - accuracy: 0.6873
Epoch 15/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5957 - accuracy: 0.6863
Epoch 16/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5952 - accuracy: 0.6869
Epoch 17/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5944 - accuracy: 0.6863
Epoch 18/27
20000/20000 [==============================] - 0s 6us/step - loss: 0.5939 - accuracy: 0.6874
Epoch 19/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5934 - accuracy: 0.6880
Epoch 20/27
20000/20000 [==============================] - 0s 4us/step - loss: 0.5929 - accuracy: 0.6865
Epoch 21/27
20000/20000 [==============================] - 0s 4us/step - loss: 0.5925 - accuracy: 0.6881
Epoch 22/27
20000/20000 [==============================] - 0s 4us/step - loss: 0.5917 - accuracy: 0.6891
Epoch 23/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5916 - accuracy: 0.6871
Epoch 24/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5905 - accuracy: 0.6886
Epoch 25/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5904 - accuracy: 0.6870
Epoch 26/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5899 - accuracy: 0.6893
Epoch 27/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5900 - accuracy: 0.6894
5697/5697 [==============================] - 0s 19us/step
Epoch 1/28
20000/20000 [==============================] - 0s 10us/step - loss: 0.6948 - accuracy: 0.5977
Epoch 2/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6363 - accuracy: 0.6618
Epoch 3/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6191 - accuracy: 0.6789
Epoch 4/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6117 - accuracy: 0.6813
Epoch 5/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6079 - accuracy: 0.6827
Epoch 6/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6050 - accuracy: 0.6833
Epoch 7/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6032 - accuracy: 0.6833
Epoch 8/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6019 - accuracy: 0.6825
Epoch 9/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6006 - accuracy: 0.6828
Epoch 10/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5991 - accuracy: 0.6846
Epoch 11/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5985 - accuracy: 0.6841
Epoch 12/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5975 - accuracy: 0.6862
Epoch 13/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5968 - accuracy: 0.6855
Epoch 14/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5958 - accuracy: 0.6846
Epoch 15/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5953 - accuracy: 0.6858
Epoch 16/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5946 - accuracy: 0.6863
Epoch 17/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5939 - accuracy: 0.6859
Epoch 18/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5935 - accuracy: 0.6866
Epoch 19/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5926 - accuracy: 0.6864
Epoch 20/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5922 - accuracy: 0.6865
Epoch 21/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5917 - accuracy: 0.6876
Epoch 22/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5908 - accuracy: 0.6873
Epoch 23/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5905 - accuracy: 0.6881
Epoch 24/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5898 - accuracy: 0.6886
Epoch 25/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5897 - accuracy: 0.6890
Epoch 26/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5890 - accuracy: 0.6889
Epoch 27/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5886 - accuracy: 0.6888
Epoch 28/28
20000/20000 [==============================] - 0s 4us/step - loss: 0.5879 - accuracy: 0.6888
5697/5697 [==============================] - 0s 18us/step
Epoch 1/29
20000/20000 [==============================] - 0s 11us/step - loss: 0.6696 - accuracy: 0.6059
Epoch 2/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.6302 - accuracy: 0.6737
Epoch 3/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.6170 - accuracy: 0.6809
Epoch 4/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.6112 - accuracy: 0.6812
Epoch 5/29
20000/20000 [==============================] - 0s 4us/step - loss: 0.6075 - accuracy: 0.6819
Epoch 6/29
20000/20000 [==============================] - 0s 4us/step - loss: 0.6052 - accuracy: 0.6830
Epoch 7/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6033 - accuracy: 0.6832
Epoch 8/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6015 - accuracy: 0.6848
Epoch 9/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6003 - accuracy: 0.6845
Epoch 10/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5992 - accuracy: 0.6842
Epoch 11/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.5982 - accuracy: 0.6844
Epoch 12/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5970 - accuracy: 0.6853
Epoch 13/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.5963 - accuracy: 0.6858
Epoch 14/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.5959 - accuracy: 0.6852
Epoch 15/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.5949 - accuracy: 0.6858
Epoch 16/29
20000/20000 [==============================] - 0s 8us/step - loss: 0.5941 - accuracy: 0.6862
Epoch 17/29
20000/20000 [==============================] - 0s 7us/step - loss: 0.5937 - accuracy: 0.6861
Epoch 18/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5931 - accuracy: 0.6866
Epoch 19/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5922 - accuracy: 0.6872
Epoch 20/29
20000/20000 [==============================] - 0s 4us/step - loss: 0.5917 - accuracy: 0.6867
Epoch 21/29
20000/20000 [==============================] - ETA: 0s - loss: 0.5876 - accuracy: 0.68 - 0s 5us/step - loss: 0.5910 - accuracy: 0.6870
Epoch 22/29
20000/20000 [==============================] - 0s 4us/step - loss: 0.5908 - accuracy: 0.6866
Epoch 23/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5899 - accuracy: 0.6876
Epoch 24/29
20000/20000 [==============================] - 0s 4us/step - loss: 0.5897 - accuracy: 0.6881
Epoch 25/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5891 - accuracy: 0.6884
Epoch 26/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5887 - accuracy: 0.6874
Epoch 27/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.5880 - accuracy: 0.6886
Epoch 28/29
20000/20000 [==============================] - 0s 4us/step - loss: 0.5878 - accuracy: 0.6887
Epoch 29/29
20000/20000 [==============================] - 0s 4us/step - loss: 0.5869 - accuracy: 0.6889
5697/5697 [==============================] - 0s 19us/step
Epoch 1/30
20000/20000 [==============================] - 0s 11us/step - loss: 0.6811 - accuracy: 0.6021
Epoch 2/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6306 - accuracy: 0.6695
Epoch 3/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6158 - accuracy: 0.6791
Epoch 4/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6100 - accuracy: 0.6811
Epoch 5/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6067 - accuracy: 0.6817
Epoch 6/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6044 - accuracy: 0.6825
Epoch 7/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6025 - accuracy: 0.6837
Epoch 8/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6011 - accuracy: 0.6838
Epoch 9/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5999 - accuracy: 0.6836
Epoch 10/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5986 - accuracy: 0.6837
Epoch 11/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5976 - accuracy: 0.6854
Epoch 12/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.5966 - accuracy: 0.6862
Epoch 13/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5959 - accuracy: 0.6852
Epoch 14/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5951 - accuracy: 0.6860
Epoch 15/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5943 - accuracy: 0.6855
Epoch 16/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5937 - accuracy: 0.6866
Epoch 17/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5930 - accuracy: 0.6860
Epoch 18/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5922 - accuracy: 0.6873
Epoch 19/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5917 - accuracy: 0.6878
Epoch 20/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5913 - accuracy: 0.6888
Epoch 21/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5903 - accuracy: 0.6880
Epoch 22/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5900 - accuracy: 0.6884
Epoch 23/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5897 - accuracy: 0.6902
Epoch 24/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5890 - accuracy: 0.6891
Epoch 25/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.5885 - accuracy: 0.6902
Epoch 26/30
20000/20000 [==============================] - 0s 8us/step - loss: 0.5878 - accuracy: 0.6903
Epoch 27/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5875 - accuracy: 0.6913
Epoch 28/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.5867 - accuracy: 0.6896
Epoch 29/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.5863 - accuracy: 0.6910
Epoch 30/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5857 - accuracy: 0.6903
5697/5697 [==============================] - 0s 19us/step
Epoch 1/7
20000/20000 [==============================] - 0s 12us/step - loss: 0.6608 - accuracy: 0.6362
Epoch 2/7
20000/20000 [==============================] - 0s 7us/step - loss: 0.6289 - accuracy: 0.6742
Epoch 3/7
20000/20000 [==============================] - 0s 6us/step - loss: 0.6171 - accuracy: 0.6798
Epoch 4/7
20000/20000 [==============================] - 0s 7us/step - loss: 0.6113 - accuracy: 0.6812
Epoch 5/7
20000/20000 [==============================] - 0s 5us/step - loss: 0.6081 - accuracy: 0.6827
Epoch 6/7
20000/20000 [==============================] - 0s 6us/step - loss: 0.6059 - accuracy: 0.6832
Epoch 7/7
20000/20000 [==============================] - 0s 5us/step - loss: 0.6043 - accuracy: 0.6837
5697/5697 [==============================] - 0s 20us/step
Epoch 1/8
20000/20000 [==============================] - 0s 13us/step - loss: 0.6599 - accuracy: 0.6234
Epoch 2/8
20000/20000 [==============================] - 0s 6us/step - loss: 0.6257 - accuracy: 0.6733
Epoch 3/8
20000/20000 [==============================] - 0s 5us/step - loss: 0.6165 - accuracy: 0.6794
Epoch 4/8
20000/20000 [==============================] - 0s 5us/step - loss: 0.6116 - accuracy: 0.6798
Epoch 5/8
20000/20000 [==============================] - 0s 6us/step - loss: 0.6088 - accuracy: 0.6808
Epoch 6/8
20000/20000 [==============================] - 0s 7us/step - loss: 0.6062 - accuracy: 0.6812
Epoch 7/8
20000/20000 [==============================] - 0s 9us/step - loss: 0.6041 - accuracy: 0.6819
Epoch 8/8
20000/20000 [==============================] - 0s 6us/step - loss: 0.6030 - accuracy: 0.6834
5697/5697 [==============================] - 0s 20us/step
Epoch 1/9
20000/20000 [==============================] - 0s 14us/step - loss: 0.6653 - accuracy: 0.6301
Epoch 2/9
20000/20000 [==============================] - 0s 7us/step - loss: 0.6270 - accuracy: 0.6762
Epoch 3/9
20000/20000 [==============================] - 0s 10us/step - loss: 0.6165 - accuracy: 0.6791
Epoch 4/9
20000/20000 [==============================] - 0s 8us/step - loss: 0.6112 - accuracy: 0.6804
Epoch 5/9
20000/20000 [==============================] - 0s 7us/step - loss: 0.6073 - accuracy: 0.6810
Epoch 6/9
20000/20000 [==============================] - 0s 6us/step - loss: 0.6046 - accuracy: 0.6827
Epoch 7/9
20000/20000 [==============================] - 0s 6us/step - loss: 0.6030 - accuracy: 0.6826
Epoch 8/9
20000/20000 [==============================] - 0s 5us/step - loss: 0.6019 - accuracy: 0.6826
Epoch 9/9
20000/20000 [==============================] - 0s 7us/step - loss: 0.6010 - accuracy: 0.6831
5697/5697 [==============================] - 0s 19us/step
Epoch 1/10
20000/20000 [==============================] - 0s 12us/step - loss: 0.6638 - accuracy: 0.6223
Epoch 2/10
20000/20000 [==============================] - 0s 6us/step - loss: 0.6268 - accuracy: 0.6738
Epoch 3/10
20000/20000 [==============================] - 0s 6us/step - loss: 0.6159 - accuracy: 0.6790
Epoch 4/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.6104 - accuracy: 0.6817
Epoch 5/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.6074 - accuracy: 0.6819
Epoch 6/10
20000/20000 [==============================] - 0s 6us/step - loss: 0.6049 - accuracy: 0.6827
Epoch 7/10
20000/20000 [==============================] - 0s 7us/step - loss: 0.6030 - accuracy: 0.6838
Epoch 8/10
20000/20000 [==============================] - 0s 8us/step - loss: 0.6015 - accuracy: 0.6837
Epoch 9/10
20000/20000 [==============================] - 0s 6us/step - loss: 0.6002 - accuracy: 0.6842
Epoch 10/10
20000/20000 [==============================] - 0s 7us/step - loss: 0.5992 - accuracy: 0.6849
5697/5697 [==============================] - 0s 24us/step
Epoch 1/11
20000/20000 [==============================] - 0s 12us/step - loss: 0.6732 - accuracy: 0.5996
Epoch 2/11
20000/20000 [==============================] - 0s 7us/step - loss: 0.6290 - accuracy: 0.6726
Epoch 3/11
20000/20000 [==============================] - 0s 7us/step - loss: 0.6158 - accuracy: 0.6805
Epoch 4/11
20000/20000 [==============================] - 0s 6us/step - loss: 0.6099 - accuracy: 0.6822
Epoch 5/11
20000/20000 [==============================] - 0s 7us/step - loss: 0.6066 - accuracy: 0.6826
Epoch 6/11
20000/20000 [==============================] - 0s 7us/step - loss: 0.6050 - accuracy: 0.6820
Epoch 7/11
20000/20000 [==============================] - 0s 7us/step - loss: 0.6031 - accuracy: 0.6834
Epoch 8/11
20000/20000 [==============================] - 0s 7us/step - loss: 0.6018 - accuracy: 0.6841
Epoch 9/11
20000/20000 [==============================] - 0s 6us/step - loss: 0.6002 - accuracy: 0.6838
Epoch 10/11
20000/20000 [==============================] - 0s 5us/step - loss: 0.5994 - accuracy: 0.6851
Epoch 11/11
20000/20000 [==============================] - 0s 7us/step - loss: 0.5982 - accuracy: 0.6847
5697/5697 [==============================] - 0s 20us/step
Epoch 1/12
20000/20000 [==============================] - 0s 14us/step - loss: 0.6629 - accuracy: 0.6179
Epoch 2/12
20000/20000 [==============================] - 0s 8us/step - loss: 0.6259 - accuracy: 0.6732
Epoch 3/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6148 - accuracy: 0.6808
Epoch 4/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6100 - accuracy: 0.6812
Epoch 5/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6072 - accuracy: 0.6816
Epoch 6/12
20000/20000 [==============================] - 0s 6us/step - loss: 0.6048 - accuracy: 0.6836
Epoch 7/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6031 - accuracy: 0.6843
Epoch 8/12
20000/20000 [==============================] - 0s 4us/step - loss: 0.6017 - accuracy: 0.6833
Epoch 9/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6006 - accuracy: 0.6847
Epoch 10/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.5997 - accuracy: 0.6836
Epoch 11/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.5988 - accuracy: 0.6856
Epoch 12/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.5980 - accuracy: 0.6860
5697/5697 [==============================] - 0s 17us/step
Epoch 1/13
20000/20000 [==============================] - 0s 11us/step - loss: 0.6784 - accuracy: 0.5932
Epoch 2/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6347 - accuracy: 0.6717
Epoch 3/13
20000/20000 [==============================] - 0s 6us/step - loss: 0.6208 - accuracy: 0.6794
Epoch 4/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6139 - accuracy: 0.6808
Epoch 5/13
20000/20000 [==============================] - 0s 6us/step - loss: 0.6096 - accuracy: 0.6816
Epoch 6/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6074 - accuracy: 0.6812
Epoch 7/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6049 - accuracy: 0.6826
Epoch 8/13
20000/20000 [==============================] - 0s 4us/step - loss: 0.6037 - accuracy: 0.6823
Epoch 9/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6024 - accuracy: 0.6826
Epoch 10/13
20000/20000 [==============================] - 0s 7us/step - loss: 0.6014 - accuracy: 0.6841
Epoch 11/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6005 - accuracy: 0.6842
Epoch 12/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.5992 - accuracy: 0.6846
Epoch 13/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.5984 - accuracy: 0.6848
5697/5697 [==============================] - 0s 20us/step
Epoch 1/14
20000/20000 [==============================] - 0s 12us/step - loss: 0.6692 - accuracy: 0.6022
Epoch 2/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6292 - accuracy: 0.6715
Epoch 3/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6173 - accuracy: 0.6794
Epoch 4/14
20000/20000 [==============================] - 0s 9us/step - loss: 0.6120 - accuracy: 0.6814
Epoch 5/14
20000/20000 [==============================] - 0s 7us/step - loss: 0.6087 - accuracy: 0.6821
Epoch 6/14
20000/20000 [==============================] - 0s 7us/step - loss: 0.6065 - accuracy: 0.6824
Epoch 7/14
20000/20000 [==============================] - 0s 7us/step - loss: 0.6049 - accuracy: 0.6820
Epoch 8/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6030 - accuracy: 0.6835
Epoch 9/14
20000/20000 [==============================] - 0s 6us/step - loss: 0.6018 - accuracy: 0.6835
Epoch 10/14
20000/20000 [==============================] - 0s 8us/step - loss: 0.6009 - accuracy: 0.6843
Epoch 11/14
20000/20000 [==============================] - 0s 6us/step - loss: 0.6000 - accuracy: 0.6838
Epoch 12/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.5994 - accuracy: 0.6837
Epoch 13/14
20000/20000 [==============================] - 0s 4us/step - loss: 0.5984 - accuracy: 0.6844
Epoch 14/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.5970 - accuracy: 0.6852
5697/5697 [==============================] - 0s 20us/step
Epoch 1/15
20000/20000 [==============================] - 0s 11us/step - loss: 0.6581 - accuracy: 0.6265
Epoch 2/15
20000/20000 [==============================] - 0s 6us/step - loss: 0.6220 - accuracy: 0.6775
Epoch 3/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6131 - accuracy: 0.6809
Epoch 4/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6090 - accuracy: 0.6819
Epoch 5/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6061 - accuracy: 0.6827
Epoch 6/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6040 - accuracy: 0.6827
Epoch 7/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6024 - accuracy: 0.6831
Epoch 8/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6007 - accuracy: 0.6844
Epoch 9/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6002 - accuracy: 0.6832
Epoch 10/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.5986 - accuracy: 0.6843
Epoch 11/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.5984 - accuracy: 0.6854
Epoch 12/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.5967 - accuracy: 0.6856
Epoch 13/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.5963 - accuracy: 0.6852
Epoch 14/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.5956 - accuracy: 0.6860
Epoch 15/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.5943 - accuracy: 0.6867
5697/5697 [==============================] - 0s 19us/step
Epoch 1/16
20000/20000 [==============================] - 0s 12us/step - loss: 0.6563 - accuracy: 0.6303
Epoch 2/16
20000/20000 [==============================] - 0s 6us/step - loss: 0.6230 - accuracy: 0.6754
Epoch 3/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6135 - accuracy: 0.6790
Epoch 4/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6090 - accuracy: 0.6814
Epoch 5/16
20000/20000 [==============================] - 0s 4us/step - loss: 0.6061 - accuracy: 0.6819
Epoch 6/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6038 - accuracy: 0.6822
Epoch 7/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6021 - accuracy: 0.6824
Epoch 8/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6010 - accuracy: 0.6841
Epoch 9/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.5994 - accuracy: 0.6846
Epoch 10/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.5988 - accuracy: 0.6848
Epoch 11/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.5974 - accuracy: 0.6844
Epoch 12/16
20000/20000 [==============================] - 0s 6us/step - loss: 0.5967 - accuracy: 0.6848
Epoch 13/16
20000/20000 [==============================] - 0s 9us/step - loss: 0.5961 - accuracy: 0.6842
Epoch 14/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.5951 - accuracy: 0.6859
Epoch 15/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.5943 - accuracy: 0.6858
Epoch 16/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.5936 - accuracy: 0.6861
5697/5697 [==============================] - 0s 22us/step
Epoch 1/17
20000/20000 [==============================] - 0s 12us/step - loss: 0.6619 - accuracy: 0.6230
Epoch 2/17
20000/20000 [==============================] - 0s 8us/step - loss: 0.6253 - accuracy: 0.6771
Epoch 3/17
20000/20000 [==============================] - 0s 8us/step - loss: 0.6146 - accuracy: 0.6801
Epoch 4/17
20000/20000 [==============================] - 0s 6us/step - loss: 0.6096 - accuracy: 0.6816
Epoch 5/17
20000/20000 [==============================] - 0s 6us/step - loss: 0.6066 - accuracy: 0.6819
Epoch 6/17
20000/20000 [==============================] - 0s 6us/step - loss: 0.6043 - accuracy: 0.6834
Epoch 7/17
20000/20000 [==============================] - 0s 6us/step - loss: 0.6022 - accuracy: 0.6828
Epoch 8/17
20000/20000 [==============================] - 0s 6us/step - loss: 0.6010 - accuracy: 0.6833
Epoch 9/17
20000/20000 [==============================] - 0s 6us/step - loss: 0.5998 - accuracy: 0.6852
Epoch 10/17
20000/20000 [==============================] - 0s 7us/step - loss: 0.5986 - accuracy: 0.6843
Epoch 11/17
20000/20000 [==============================] - 0s 6us/step - loss: 0.5978 - accuracy: 0.6848
Epoch 12/17
20000/20000 [==============================] - 0s 6us/step - loss: 0.5967 - accuracy: 0.6844
Epoch 13/17
20000/20000 [==============================] - 0s 6us/step - loss: 0.5961 - accuracy: 0.6846
Epoch 14/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.5953 - accuracy: 0.6859
Epoch 15/17
20000/20000 [==============================] - 0s 7us/step - loss: 0.5943 - accuracy: 0.6863
Epoch 16/17
20000/20000 [==============================] - 0s 7us/step - loss: 0.5937 - accuracy: 0.6855
Epoch 17/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.5927 - accuracy: 0.6870
5697/5697 [==============================] - 0s 37us/step
Epoch 1/18
20000/20000 [==============================] - 0s 12us/step - loss: 0.6721 - accuracy: 0.6051
Epoch 2/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.6269 - accuracy: 0.6715
Epoch 3/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.6148 - accuracy: 0.6790
Epoch 4/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.6096 - accuracy: 0.6811
Epoch 5/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6068 - accuracy: 0.6819
Epoch 6/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6047 - accuracy: 0.6834
Epoch 7/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6034 - accuracy: 0.6830
Epoch 8/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6020 - accuracy: 0.6838
Epoch 9/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6004 - accuracy: 0.6848
Epoch 10/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5994 - accuracy: 0.6849
Epoch 11/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5990 - accuracy: 0.6841
Epoch 12/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5980 - accuracy: 0.6845
Epoch 13/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5972 - accuracy: 0.6851
Epoch 14/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5962 - accuracy: 0.6863
Epoch 15/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.5958 - accuracy: 0.6867
Epoch 16/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5948 - accuracy: 0.6873
Epoch 17/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5943 - accuracy: 0.6870
Epoch 18/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5940 - accuracy: 0.6874
5697/5697 [==============================] - 0s 19us/step
Epoch 1/19
20000/20000 [==============================] - 0s 11us/step - loss: 0.6642 - accuracy: 0.6190
Epoch 2/19
20000/20000 [==============================] - 0s 6us/step - loss: 0.6268 - accuracy: 0.6753
Epoch 3/19
20000/20000 [==============================] - 0s 6us/step - loss: 0.6160 - accuracy: 0.6788
Epoch 4/19
20000/20000 [==============================] - 0s 6us/step - loss: 0.6108 - accuracy: 0.6804
Epoch 5/19
20000/20000 [==============================] - 0s 6us/step - loss: 0.6078 - accuracy: 0.6816
Epoch 6/19
20000/20000 [==============================] - 0s 6us/step - loss: 0.6057 - accuracy: 0.6812
Epoch 7/19
20000/20000 [==============================] - 0s 6us/step - loss: 0.6041 - accuracy: 0.6824
Epoch 8/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6025 - accuracy: 0.6825
Epoch 9/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6011 - accuracy: 0.6828
Epoch 10/19
20000/20000 [==============================] - 0s 6us/step - loss: 0.6001 - accuracy: 0.6841
Epoch 11/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5992 - accuracy: 0.6838
Epoch 12/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5985 - accuracy: 0.6844
Epoch 13/19
20000/20000 [==============================] - 0s 6us/step - loss: 0.5972 - accuracy: 0.6840
Epoch 14/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5968 - accuracy: 0.6850
Epoch 15/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5959 - accuracy: 0.6846
Epoch 16/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5955 - accuracy: 0.6858
Epoch 17/19
20000/20000 [==============================] - 0s 6us/step - loss: 0.5947 - accuracy: 0.6873
Epoch 18/19
20000/20000 [==============================] - 0s 6us/step - loss: 0.5937 - accuracy: 0.6862
Epoch 19/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5930 - accuracy: 0.6869
5697/5697 [==============================] - 0s 20us/step
Epoch 1/20
20000/20000 [==============================] - 0s 12us/step - loss: 0.6707 - accuracy: 0.6079
Epoch 2/20
20000/20000 [==============================] - 0s 6us/step - loss: 0.6298 - accuracy: 0.6749
Epoch 3/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6177 - accuracy: 0.6798
Epoch 4/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6122 - accuracy: 0.6813
Epoch 5/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6082 - accuracy: 0.6824
Epoch 6/20
20000/20000 [==============================] - 0s 6us/step - loss: 0.6059 - accuracy: 0.6826
Epoch 7/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6042 - accuracy: 0.6835
Epoch 8/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6028 - accuracy: 0.6830
Epoch 9/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6013 - accuracy: 0.6837
Epoch 10/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6001 - accuracy: 0.6834
Epoch 11/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5991 - accuracy: 0.6848
Epoch 12/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5982 - accuracy: 0.6844
Epoch 13/20
20000/20000 [==============================] - 0s 6us/step - loss: 0.5970 - accuracy: 0.6851
Epoch 14/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5964 - accuracy: 0.6864
Epoch 15/20
20000/20000 [==============================] - 0s 6us/step - loss: 0.5956 - accuracy: 0.6852
Epoch 16/20
20000/20000 [==============================] - 0s 6us/step - loss: 0.5952 - accuracy: 0.6858
Epoch 17/20
20000/20000 [==============================] - 0s 7us/step - loss: 0.5941 - accuracy: 0.6867
Epoch 18/20
20000/20000 [==============================] - 0s 9us/step - loss: 0.5937 - accuracy: 0.6860
Epoch 19/20
20000/20000 [==============================] - 0s 7us/step - loss: 0.5930 - accuracy: 0.6877
Epoch 20/20
20000/20000 [==============================] - 0s 7us/step - loss: 0.5924 - accuracy: 0.6871
5697/5697 [==============================] - 0s 27us/step
Epoch 1/21
20000/20000 [==============================] - 0s 15us/step - loss: 0.6629 - accuracy: 0.6216
Epoch 2/21
20000/20000 [==============================] - 0s 6us/step - loss: 0.6283 - accuracy: 0.6725
Epoch 3/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6167 - accuracy: 0.6787
Epoch 4/21
20000/20000 [==============================] - 0s 6us/step - loss: 0.6108 - accuracy: 0.6815
Epoch 5/21
20000/20000 [==============================] - 0s 6us/step - loss: 0.6073 - accuracy: 0.6817
Epoch 6/21
20000/20000 [==============================] - 0s 6us/step - loss: 0.6056 - accuracy: 0.6811
Epoch 7/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6033 - accuracy: 0.6838
Epoch 8/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6016 - accuracy: 0.6833
Epoch 9/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6004 - accuracy: 0.6841
Epoch 10/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5991 - accuracy: 0.6837
Epoch 11/21
20000/20000 [==============================] - 0s 6us/step - loss: 0.5981 - accuracy: 0.6855
Epoch 12/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5973 - accuracy: 0.6860
Epoch 13/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5962 - accuracy: 0.6862
Epoch 14/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5958 - accuracy: 0.6858
Epoch 15/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5949 - accuracy: 0.6868
Epoch 16/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5941 - accuracy: 0.6866
Epoch 17/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5937 - accuracy: 0.6868
Epoch 18/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5928 - accuracy: 0.6873
Epoch 19/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5925 - accuracy: 0.6884
Epoch 20/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5916 - accuracy: 0.6894
Epoch 21/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5908 - accuracy: 0.6881
5697/5697 [==============================] - 0s 20us/step
Epoch 1/22
20000/20000 [==============================] - 0s 12us/step - loss: 0.6569 - accuracy: 0.6320
Epoch 2/22
20000/20000 [==============================] - 0s 6us/step - loss: 0.6255 - accuracy: 0.6744
Epoch 3/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6147 - accuracy: 0.6805
Epoch 4/22
20000/20000 [==============================] - 0s 8us/step - loss: 0.6098 - accuracy: 0.6827
Epoch 5/22
20000/20000 [==============================] - 0s 6us/step - loss: 0.6068 - accuracy: 0.6842
Epoch 6/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6044 - accuracy: 0.6834
Epoch 7/22
20000/20000 [==============================] - 0s 6us/step - loss: 0.6033 - accuracy: 0.6846
Epoch 8/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6013 - accuracy: 0.6845
Epoch 9/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6006 - accuracy: 0.6845
Epoch 10/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5992 - accuracy: 0.6847
Epoch 11/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5984 - accuracy: 0.6858
Epoch 12/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5975 - accuracy: 0.6864
Epoch 13/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5967 - accuracy: 0.6870
Epoch 14/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5959 - accuracy: 0.6853
Epoch 15/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5953 - accuracy: 0.6867
Epoch 16/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5944 - accuracy: 0.6877
Epoch 17/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5942 - accuracy: 0.6883
Epoch 18/22
20000/20000 [==============================] - 0s 6us/step - loss: 0.5934 - accuracy: 0.6865
Epoch 19/22
20000/20000 [==============================] - 0s 6us/step - loss: 0.5930 - accuracy: 0.6873
Epoch 20/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5923 - accuracy: 0.6858
Epoch 21/22
20000/20000 [==============================] - 0s 6us/step - loss: 0.5914 - accuracy: 0.6881
Epoch 22/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5908 - accuracy: 0.6872
5697/5697 [==============================] - 0s 20us/step
Epoch 1/23
20000/20000 [==============================] - 0s 12us/step - loss: 0.6558 - accuracy: 0.6392
Epoch 2/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6229 - accuracy: 0.6782
Epoch 3/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6133 - accuracy: 0.6790
Epoch 4/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6085 - accuracy: 0.6811
Epoch 5/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6055 - accuracy: 0.6815
Epoch 6/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6038 - accuracy: 0.6833
Epoch 7/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6020 - accuracy: 0.6830
Epoch 8/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6005 - accuracy: 0.6845
Epoch 9/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5994 - accuracy: 0.6844
Epoch 10/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5984 - accuracy: 0.6853
Epoch 11/23
20000/20000 [==============================] - 0s 6us/step - loss: 0.5976 - accuracy: 0.6855
Epoch 12/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5965 - accuracy: 0.6859
Epoch 13/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5959 - accuracy: 0.6855
Epoch 14/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5950 - accuracy: 0.6865
Epoch 15/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5945 - accuracy: 0.6863
Epoch 16/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5940 - accuracy: 0.6862
Epoch 17/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5929 - accuracy: 0.6858
Epoch 18/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5931 - accuracy: 0.6859
Epoch 19/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5922 - accuracy: 0.6871
Epoch 20/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5915 - accuracy: 0.6865
Epoch 21/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5909 - accuracy: 0.6872
Epoch 22/23
20000/20000 [==============================] - 0s 6us/step - loss: 0.5901 - accuracy: 0.6880
Epoch 23/23
20000/20000 [==============================] - 0s 6us/step - loss: 0.5898 - accuracy: 0.6867
5697/5697 [==============================] - 0s 19us/step
Epoch 1/24
20000/20000 [==============================] - 0s 11us/step - loss: 0.6668 - accuracy: 0.6043
Epoch 2/24
20000/20000 [==============================] - 0s 6us/step - loss: 0.6310 - accuracy: 0.6671
Epoch 3/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6173 - accuracy: 0.6787
Epoch 4/24
20000/20000 [==============================] - 0s 6us/step - loss: 0.6113 - accuracy: 0.6816
Epoch 5/24
20000/20000 [==============================] - 0s 6us/step - loss: 0.6073 - accuracy: 0.6828
Epoch 6/24
20000/20000 [==============================] - 0s 6us/step - loss: 0.6053 - accuracy: 0.6834
Epoch 7/24
20000/20000 [==============================] - 0s 6us/step - loss: 0.6034 - accuracy: 0.6847
Epoch 8/24
20000/20000 [==============================] - 0s 6us/step - loss: 0.6023 - accuracy: 0.6839
Epoch 9/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6011 - accuracy: 0.6848: 0s - loss: 0.5978 - accuracy: 0.
Epoch 10/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5998 - accuracy: 0.6851
Epoch 11/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5989 - accuracy: 0.6853
Epoch 12/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5980 - accuracy: 0.6856
Epoch 13/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5975 - accuracy: 0.6870
Epoch 14/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5963 - accuracy: 0.6867
Epoch 15/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5958 - accuracy: 0.6866
Epoch 16/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5948 - accuracy: 0.6877
Epoch 17/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5944 - accuracy: 0.6870
Epoch 18/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5937 - accuracy: 0.6876
Epoch 19/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5929 - accuracy: 0.6870
Epoch 20/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5925 - accuracy: 0.6875
Epoch 21/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5916 - accuracy: 0.6884
Epoch 22/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5913 - accuracy: 0.6880
Epoch 23/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5903 - accuracy: 0.6884
Epoch 24/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5902 - accuracy: 0.6880
5697/5697 [==============================] - 0s 20us/step
Epoch 1/25
20000/20000 [==============================] - 0s 11us/step - loss: 0.6609 - accuracy: 0.6263
Epoch 2/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.6275 - accuracy: 0.6788
Epoch 3/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.6173 - accuracy: 0.6805
Epoch 4/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.6113 - accuracy: 0.6810
Epoch 5/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6072 - accuracy: 0.6829
Epoch 6/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6052 - accuracy: 0.6832
Epoch 7/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6034 - accuracy: 0.6844
Epoch 8/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6020 - accuracy: 0.6826
Epoch 9/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6007 - accuracy: 0.6851
Epoch 10/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5995 - accuracy: 0.6844
Epoch 11/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5984 - accuracy: 0.6851
Epoch 12/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5978 - accuracy: 0.6855
Epoch 13/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5971 - accuracy: 0.6855
Epoch 14/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5963 - accuracy: 0.6858
Epoch 15/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5952 - accuracy: 0.6870
Epoch 16/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5947 - accuracy: 0.6874
Epoch 17/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5939 - accuracy: 0.6869
Epoch 18/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5931 - accuracy: 0.6873
Epoch 19/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.5930 - accuracy: 0.6885
Epoch 20/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.5924 - accuracy: 0.6875
Epoch 21/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5914 - accuracy: 0.6888
Epoch 22/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5911 - accuracy: 0.6881
Epoch 23/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5904 - accuracy: 0.6879
Epoch 24/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5895 - accuracy: 0.6887
Epoch 25/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5897 - accuracy: 0.6883
5697/5697 [==============================] - 0s 19us/step
Epoch 1/26
20000/20000 [==============================] - 0s 11us/step - loss: 0.6733 - accuracy: 0.6148
Epoch 2/26
20000/20000 [==============================] - 0s 6us/step - loss: 0.6268 - accuracy: 0.6676
Epoch 3/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6155 - accuracy: 0.6783
Epoch 4/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6111 - accuracy: 0.6809
Epoch 5/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6078 - accuracy: 0.6819
Epoch 6/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6056 - accuracy: 0.6827
Epoch 7/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6039 - accuracy: 0.6834
Epoch 8/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6025 - accuracy: 0.6835
Epoch 9/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6013 - accuracy: 0.6843
Epoch 10/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6003 - accuracy: 0.6841
Epoch 11/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5994 - accuracy: 0.6844
Epoch 12/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5984 - accuracy: 0.6848
Epoch 13/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5974 - accuracy: 0.6852
Epoch 14/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5968 - accuracy: 0.6863
Epoch 15/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5961 - accuracy: 0.6863
Epoch 16/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5952 - accuracy: 0.6869
Epoch 17/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5948 - accuracy: 0.6868
Epoch 18/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5941 - accuracy: 0.6866
Epoch 19/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5933 - accuracy: 0.6883
Epoch 20/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5924 - accuracy: 0.6883
Epoch 21/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5915 - accuracy: 0.6880
Epoch 22/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5918 - accuracy: 0.6886
Epoch 23/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5905 - accuracy: 0.6888
Epoch 24/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5901 - accuracy: 0.6887
Epoch 25/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5900 - accuracy: 0.6895
Epoch 26/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5892 - accuracy: 0.6896
5697/5697 [==============================] - 0s 20us/step
Epoch 1/27
20000/20000 [==============================] - 0s 12us/step - loss: 0.6495 - accuracy: 0.6402
Epoch 2/27
20000/20000 [==============================] - 0s 6us/step - loss: 0.6213 - accuracy: 0.6782
Epoch 3/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6128 - accuracy: 0.6806
Epoch 4/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6088 - accuracy: 0.6814
Epoch 5/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6064 - accuracy: 0.6826
Epoch 6/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6041 - accuracy: 0.6839
Epoch 7/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6028 - accuracy: 0.6837
Epoch 8/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6015 - accuracy: 0.6841
Epoch 9/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6002 - accuracy: 0.6847
Epoch 10/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5990 - accuracy: 0.6858
Epoch 11/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5982 - accuracy: 0.6848
Epoch 12/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5974 - accuracy: 0.6863
Epoch 13/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5969 - accuracy: 0.6864
Epoch 14/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5962 - accuracy: 0.6863
Epoch 15/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5954 - accuracy: 0.6866
Epoch 16/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5949 - accuracy: 0.6870
Epoch 17/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5944 - accuracy: 0.6866
Epoch 18/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5934 - accuracy: 0.6878
Epoch 19/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5930 - accuracy: 0.6879
Epoch 20/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5922 - accuracy: 0.6881
Epoch 21/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5918 - accuracy: 0.6884
Epoch 22/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5909 - accuracy: 0.6894
Epoch 23/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5902 - accuracy: 0.6895
Epoch 24/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5900 - accuracy: 0.6899
Epoch 25/27
20000/20000 [==============================] - 0s 6us/step - loss: 0.5895 - accuracy: 0.6889
Epoch 26/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5889 - accuracy: 0.6905
Epoch 27/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5883 - accuracy: 0.6904
5697/5697 [==============================] - 0s 22us/step
Epoch 1/28
20000/20000 [==============================] - 0s 11us/step - loss: 0.6698 - accuracy: 0.5967
Epoch 2/28
20000/20000 [==============================] - 0s 6us/step - loss: 0.6287 - accuracy: 0.6704
Epoch 3/28
20000/20000 [==============================] - 0s 6us/step - loss: 0.6160 - accuracy: 0.6799
Epoch 4/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6106 - accuracy: 0.6803
Epoch 5/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6075 - accuracy: 0.6814
Epoch 6/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6054 - accuracy: 0.6816
Epoch 7/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6034 - accuracy: 0.6834
Epoch 8/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6018 - accuracy: 0.6829
Epoch 9/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6007 - accuracy: 0.6826
Epoch 10/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5993 - accuracy: 0.6848
Epoch 11/28
20000/20000 [==============================] - 0s 6us/step - loss: 0.5988 - accuracy: 0.6847
Epoch 12/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5979 - accuracy: 0.6849
Epoch 13/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5967 - accuracy: 0.6854
Epoch 14/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5963 - accuracy: 0.6859
Epoch 15/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5955 - accuracy: 0.6852
Epoch 16/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5945 - accuracy: 0.6866
Epoch 17/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5945 - accuracy: 0.6859
Epoch 18/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5935 - accuracy: 0.6873
Epoch 19/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5929 - accuracy: 0.6872
Epoch 20/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5920 - accuracy: 0.6877
Epoch 21/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5914 - accuracy: 0.6880
Epoch 22/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5911 - accuracy: 0.6883
Epoch 23/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5904 - accuracy: 0.6888
Epoch 24/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5898 - accuracy: 0.6895
Epoch 25/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5892 - accuracy: 0.6898
Epoch 26/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5888 - accuracy: 0.6902
Epoch 27/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5881 - accuracy: 0.6904
Epoch 28/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5878 - accuracy: 0.6908
5697/5697 [==============================] - 0s 18us/step
Epoch 1/29
20000/20000 [==============================] - 0s 11us/step - loss: 0.6864 - accuracy: 0.5954
Epoch 2/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.6296 - accuracy: 0.6719
Epoch 3/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.6160 - accuracy: 0.6796
Epoch 4/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.6102 - accuracy: 0.6811
Epoch 5/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.6069 - accuracy: 0.6827: 0s - loss: 0.6055 - accuracy: 0.
Epoch 6/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6044 - accuracy: 0.6837
Epoch 7/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6025 - accuracy: 0.6836
Epoch 8/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6011 - accuracy: 0.6842
Epoch 9/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6001 - accuracy: 0.6848
Epoch 10/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5990 - accuracy: 0.6849
Epoch 11/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5977 - accuracy: 0.6863
Epoch 12/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5967 - accuracy: 0.6864
Epoch 13/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5958 - accuracy: 0.6865
Epoch 14/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5954 - accuracy: 0.6865
Epoch 15/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5947 - accuracy: 0.6873
Epoch 16/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5940 - accuracy: 0.6873
Epoch 17/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.5936 - accuracy: 0.6871
Epoch 18/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5926 - accuracy: 0.6894
Epoch 19/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5920 - accuracy: 0.6883
Epoch 20/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5911 - accuracy: 0.6886
Epoch 21/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5914 - accuracy: 0.6891
Epoch 22/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5904 - accuracy: 0.6881
Epoch 23/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5895 - accuracy: 0.6891
Epoch 24/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5895 - accuracy: 0.6892
Epoch 25/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5887 - accuracy: 0.6898
Epoch 26/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5882 - accuracy: 0.6897
Epoch 27/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5882 - accuracy: 0.6887
Epoch 28/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5874 - accuracy: 0.6890
Epoch 29/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.5867 - accuracy: 0.6899
5697/5697 [==============================] - 0s 18us/step
Epoch 1/30
20000/20000 [==============================] - 0s 11us/step - loss: 0.6623 - accuracy: 0.6218
Epoch 2/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6265 - accuracy: 0.6765
Epoch 3/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6160 - accuracy: 0.6801
Epoch 4/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6101 - accuracy: 0.6819
Epoch 5/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.6066 - accuracy: 0.6812
Epoch 6/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.6041 - accuracy: 0.6819
Epoch 7/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.6027 - accuracy: 0.6830
Epoch 8/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6007 - accuracy: 0.6844
Epoch 9/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5994 - accuracy: 0.6848
Epoch 10/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5983 - accuracy: 0.6847
Epoch 11/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5975 - accuracy: 0.6858
Epoch 12/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5964 - accuracy: 0.6869
Epoch 13/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5954 - accuracy: 0.6876
Epoch 14/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5947 - accuracy: 0.6872
Epoch 15/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5944 - accuracy: 0.6872
Epoch 16/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5936 - accuracy: 0.6884
Epoch 17/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.5928 - accuracy: 0.6888
Epoch 18/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5921 - accuracy: 0.6895
Epoch 19/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5912 - accuracy: 0.6895
Epoch 20/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5906 - accuracy: 0.6901
Epoch 21/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.5907 - accuracy: 0.6895
Epoch 22/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5892 - accuracy: 0.6903
Epoch 23/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5893 - accuracy: 0.6895
Epoch 24/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5889 - accuracy: 0.6901
Epoch 25/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.5882 - accuracy: 0.6902
Epoch 26/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.5875 - accuracy: 0.6906
Epoch 27/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5872 - accuracy: 0.6913
Epoch 28/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5865 - accuracy: 0.6926
Epoch 29/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5857 - accuracy: 0.6931
Epoch 30/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5858 - accuracy: 0.6916
5697/5697 [==============================] - 0s 19us/step
Epoch 1/7
20000/20000 [==============================] - 0s 17us/step - loss: 0.6762 - accuracy: 0.6145
Epoch 2/7
20000/20000 [==============================] - 0s 6us/step - loss: 0.6238 - accuracy: 0.6755
Epoch 3/7
20000/20000 [==============================] - 0s 5us/step - loss: 0.6125 - accuracy: 0.6813
Epoch 4/7
20000/20000 [==============================] - 0s 6us/step - loss: 0.6077 - accuracy: 0.6823
Epoch 5/7
20000/20000 [==============================] - 0s 5us/step - loss: 0.6047 - accuracy: 0.6830
Epoch 6/7
20000/20000 [==============================] - 0s 6us/step - loss: 0.6025 - accuracy: 0.6835
Epoch 7/7
20000/20000 [==============================] - 0s 5us/step - loss: 0.6008 - accuracy: 0.6842
5697/5697 [==============================] - 0s 18us/step
Epoch 1/8
20000/20000 [==============================] - 0s 12us/step - loss: 0.6567 - accuracy: 0.6338
Epoch 2/8
20000/20000 [==============================] - 0s 6us/step - loss: 0.6225 - accuracy: 0.6778
Epoch 3/8
20000/20000 [==============================] - 0s 6us/step - loss: 0.6137 - accuracy: 0.6794
Epoch 4/8
20000/20000 [==============================] - 0s 6us/step - loss: 0.6090 - accuracy: 0.6801
Epoch 5/8
20000/20000 [==============================] - 0s 9us/step - loss: 0.6061 - accuracy: 0.6819
Epoch 6/8
20000/20000 [==============================] - 0s 6us/step - loss: 0.6033 - accuracy: 0.6820
Epoch 7/8
20000/20000 [==============================] - 0s 6us/step - loss: 0.6017 - accuracy: 0.6834
Epoch 8/8
20000/20000 [==============================] - 0s 5us/step - loss: 0.6006 - accuracy: 0.6841
5697/5697 [==============================] - 0s 19us/step
Epoch 1/9
20000/20000 [==============================] - 0s 14us/step - loss: 0.6576 - accuracy: 0.6371
Epoch 2/9
20000/20000 [==============================] - 0s 5us/step - loss: 0.6161 - accuracy: 0.6806
Epoch 3/9
20000/20000 [==============================] - 0s 5us/step - loss: 0.6087 - accuracy: 0.6832
Epoch 4/9
20000/20000 [==============================] - 0s 5us/step - loss: 0.6053 - accuracy: 0.6833
Epoch 5/9
20000/20000 [==============================] - 0s 6us/step - loss: 0.6026 - accuracy: 0.6838
Epoch 6/9
20000/20000 [==============================] - 0s 5us/step - loss: 0.6008 - accuracy: 0.6849
Epoch 7/9
20000/20000 [==============================] - 0s 5us/step - loss: 0.5991 - accuracy: 0.6851
Epoch 8/9
20000/20000 [==============================] - 0s 6us/step - loss: 0.5975 - accuracy: 0.6864
Epoch 9/9
20000/20000 [==============================] - 0s 5us/step - loss: 0.5966 - accuracy: 0.6859
5697/5697 [==============================] - 0s 20us/step
Epoch 1/10
20000/20000 [==============================] - 0s 12us/step - loss: 0.6573 - accuracy: 0.6276
Epoch 2/10
20000/20000 [==============================] - 0s 6us/step - loss: 0.6207 - accuracy: 0.6769
Epoch 3/10
20000/20000 [==============================] - 0s 6us/step - loss: 0.6117 - accuracy: 0.6813
Epoch 4/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.6079 - accuracy: 0.6823
Epoch 5/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.6049 - accuracy: 0.6831
Epoch 6/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.6030 - accuracy: 0.6841
Epoch 7/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.6013 - accuracy: 0.6837
Epoch 8/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.6001 - accuracy: 0.6849
Epoch 9/10
20000/20000 [==============================] - 0s 6us/step - loss: 0.5988 - accuracy: 0.6852
Epoch 10/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.5975 - accuracy: 0.6847
5697/5697 [==============================] - 0s 19us/step
Epoch 1/11
20000/20000 [==============================] - 0s 12us/step - loss: 0.6757 - accuracy: 0.6020
Epoch 2/11
20000/20000 [==============================] - 0s 6us/step - loss: 0.6242 - accuracy: 0.6758
Epoch 3/11
20000/20000 [==============================] - 0s 6us/step - loss: 0.6120 - accuracy: 0.6808
Epoch 4/11
20000/20000 [==============================] - 0s 5us/step - loss: 0.6071 - accuracy: 0.6819
Epoch 5/11
20000/20000 [==============================] - 0s 6us/step - loss: 0.6042 - accuracy: 0.6837
Epoch 6/11
20000/20000 [==============================] - 0s 6us/step - loss: 0.6016 - accuracy: 0.6836
Epoch 7/11
20000/20000 [==============================] - 0s 5us/step - loss: 0.5999 - accuracy: 0.6851
Epoch 8/11
20000/20000 [==============================] - 0s 5us/step - loss: 0.5981 - accuracy: 0.6852
Epoch 9/11
20000/20000 [==============================] - 0s 5us/step - loss: 0.5971 - accuracy: 0.6860
Epoch 10/11
20000/20000 [==============================] - 0s 5us/step - loss: 0.5961 - accuracy: 0.6862
Epoch 11/11
20000/20000 [==============================] - 0s 5us/step - loss: 0.5949 - accuracy: 0.6858
5697/5697 [==============================] - 0s 20us/step
Epoch 1/12
20000/20000 [==============================] - 0s 12us/step - loss: 0.6585 - accuracy: 0.6366
Epoch 2/12
20000/20000 [==============================] - 0s 6us/step - loss: 0.6195 - accuracy: 0.6776
Epoch 3/12
20000/20000 [==============================] - 0s 6us/step - loss: 0.6109 - accuracy: 0.6817
Epoch 4/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6070 - accuracy: 0.6824
Epoch 5/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6044 - accuracy: 0.6828
Epoch 6/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6026 - accuracy: 0.6827
Epoch 7/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.6011 - accuracy: 0.6847
Epoch 8/12
20000/20000 [==============================] - 0s 6us/step - loss: 0.5995 - accuracy: 0.6850
Epoch 9/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.5985 - accuracy: 0.6856
Epoch 10/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.5973 - accuracy: 0.6850
Epoch 11/12
20000/20000 [==============================] - 0s 6us/step - loss: 0.5961 - accuracy: 0.6855
Epoch 12/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.5952 - accuracy: 0.6869
5697/5697 [==============================] - 0s 19us/step
Epoch 1/13
20000/20000 [==============================] - 0s 12us/step - loss: 0.6648 - accuracy: 0.6277
Epoch 2/13
20000/20000 [==============================] - 0s 6us/step - loss: 0.6232 - accuracy: 0.6793
Epoch 3/13
20000/20000 [==============================] - 0s 6us/step - loss: 0.6129 - accuracy: 0.6816
Epoch 4/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6083 - accuracy: 0.6816
Epoch 5/13
20000/20000 [==============================] - 0s 6us/step - loss: 0.6046 - accuracy: 0.6821
Epoch 6/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6024 - accuracy: 0.6838
Epoch 7/13
20000/20000 [==============================] - 0s 6us/step - loss: 0.6007 - accuracy: 0.6848
Epoch 8/13
20000/20000 [==============================] - 0s 8us/step - loss: 0.5990 - accuracy: 0.6854
Epoch 9/13
20000/20000 [==============================] - 0s 6us/step - loss: 0.5975 - accuracy: 0.6856
Epoch 10/13
20000/20000 [==============================] - 0s 8us/step - loss: 0.5962 - accuracy: 0.6866
Epoch 11/13
20000/20000 [==============================] - 0s 7us/step - loss: 0.5951 - accuracy: 0.6863
Epoch 12/13
20000/20000 [==============================] - 0s 8us/step - loss: 0.5940 - accuracy: 0.6882
Epoch 13/13
20000/20000 [==============================] - 0s 6us/step - loss: 0.5929 - accuracy: 0.6872
5697/5697 [==============================] - 0s 18us/step
Epoch 1/14
20000/20000 [==============================] - 0s 16us/step - loss: 0.6614 - accuracy: 0.6151 0s - loss: 0.7025 - accuracy: 
Epoch 2/14
20000/20000 [==============================] - 0s 9us/step - loss: 0.6178 - accuracy: 0.6766
Epoch 3/14
20000/20000 [==============================] - 0s 8us/step - loss: 0.6095 - accuracy: 0.6825
Epoch 4/14
20000/20000 [==============================] - 0s 7us/step - loss: 0.6058 - accuracy: 0.6831
Epoch 5/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6025 - accuracy: 0.6827
Epoch 6/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6011 - accuracy: 0.6836
Epoch 7/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.5993 - accuracy: 0.6846
Epoch 8/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.5978 - accuracy: 0.6838
Epoch 9/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.5961 - accuracy: 0.6863
Epoch 10/14
20000/20000 [==============================] - 0s 8us/step - loss: 0.5953 - accuracy: 0.6861
Epoch 11/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.5944 - accuracy: 0.6862
Epoch 12/14
20000/20000 [==============================] - 0s 6us/step - loss: 0.5934 - accuracy: 0.6862
Epoch 13/14
20000/20000 [==============================] - 0s 8us/step - loss: 0.5924 - accuracy: 0.6887
Epoch 14/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.5918 - accuracy: 0.6866
5697/5697 [==============================] - 0s 20us/step
Epoch 1/15
20000/20000 [==============================] - 0s 12us/step - loss: 0.6564 - accuracy: 0.6356
Epoch 2/15
20000/20000 [==============================] - 0s 6us/step - loss: 0.6199 - accuracy: 0.6780
Epoch 3/15
20000/20000 [==============================] - 0s 6us/step - loss: 0.6111 - accuracy: 0.6811
Epoch 4/15
20000/20000 [==============================] - 0s 6us/step - loss: 0.6070 - accuracy: 0.6819
Epoch 5/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6039 - accuracy: 0.6837
Epoch 6/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6019 - accuracy: 0.6838
Epoch 7/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6001 - accuracy: 0.6837
Epoch 8/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.5992 - accuracy: 0.6851
Epoch 9/15
20000/20000 [==============================] - 0s 6us/step - loss: 0.5977 - accuracy: 0.6848
Epoch 10/15
20000/20000 [==============================] - 0s 6us/step - loss: 0.5968 - accuracy: 0.6856
Epoch 11/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.5958 - accuracy: 0.6867
Epoch 12/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.5947 - accuracy: 0.6859
Epoch 13/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.5938 - accuracy: 0.6862
Epoch 14/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.5932 - accuracy: 0.6873
Epoch 15/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.5918 - accuracy: 0.6878
5697/5697 [==============================] - 0s 19us/step
Epoch 1/16
20000/20000 [==============================] - 0s 14us/step - loss: 0.6611 - accuracy: 0.6323
Epoch 2/16
20000/20000 [==============================] - 0s 6us/step - loss: 0.6208 - accuracy: 0.6787
Epoch 3/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6117 - accuracy: 0.6816
Epoch 4/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6071 - accuracy: 0.6824
Epoch 5/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6043 - accuracy: 0.6838
Epoch 6/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6018 - accuracy: 0.6838
Epoch 7/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6005 - accuracy: 0.6852
Epoch 8/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.5991 - accuracy: 0.6851
Epoch 9/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.5979 - accuracy: 0.6854
Epoch 10/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.5964 - accuracy: 0.6858
Epoch 11/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.5960 - accuracy: 0.6863
Epoch 12/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.5948 - accuracy: 0.6865
Epoch 13/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.5939 - accuracy: 0.6872
Epoch 14/16
20000/20000 [==============================] - 0s 6us/step - loss: 0.5931 - accuracy: 0.6865
Epoch 15/16
20000/20000 [==============================] - 0s 6us/step - loss: 0.5920 - accuracy: 0.6879
Epoch 16/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.5913 - accuracy: 0.6883
5697/5697 [==============================] - 0s 19us/step
Epoch 1/17
20000/20000 [==============================] - 0s 11us/step - loss: 0.6514 - accuracy: 0.6390
Epoch 2/17
20000/20000 [==============================] - 0s 6us/step - loss: 0.6195 - accuracy: 0.6790
Epoch 3/17
20000/20000 [==============================] - 0s 6us/step - loss: 0.6117 - accuracy: 0.6816
Epoch 4/17
20000/20000 [==============================] - 0s 6us/step - loss: 0.6072 - accuracy: 0.6833
Epoch 5/17
20000/20000 [==============================] - 0s 7us/step - loss: 0.6041 - accuracy: 0.6836
Epoch 6/17
20000/20000 [==============================] - 0s 7us/step - loss: 0.6020 - accuracy: 0.6839
Epoch 7/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6007 - accuracy: 0.6849
Epoch 8/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.5988 - accuracy: 0.6855
Epoch 9/17
20000/20000 [==============================] - 0s 7us/step - loss: 0.5976 - accuracy: 0.6858
Epoch 10/17
20000/20000 [==============================] - 0s 7us/step - loss: 0.5966 - accuracy: 0.6853
Epoch 11/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.5954 - accuracy: 0.6863
Epoch 12/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.5949 - accuracy: 0.6860
Epoch 13/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.5937 - accuracy: 0.6873
Epoch 14/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.5927 - accuracy: 0.6877
Epoch 15/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.5918 - accuracy: 0.6873
Epoch 16/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.5910 - accuracy: 0.6890
Epoch 17/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.5902 - accuracy: 0.6902
5697/5697 [==============================] - 0s 19us/step
Epoch 1/18
20000/20000 [==============================] - 0s 15us/step - loss: 0.6670 - accuracy: 0.6237
Epoch 2/18
20000/20000 [==============================] - 0s 7us/step - loss: 0.6219 - accuracy: 0.6769
Epoch 3/18
20000/20000 [==============================] - 0s 8us/step - loss: 0.6131 - accuracy: 0.6805
Epoch 4/18
20000/20000 [==============================] - 0s 7us/step - loss: 0.6083 - accuracy: 0.6830
Epoch 5/18
20000/20000 [==============================] - 0s 8us/step - loss: 0.6057 - accuracy: 0.6837
Epoch 6/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6036 - accuracy: 0.6834
Epoch 7/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6018 - accuracy: 0.6851
Epoch 8/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.6003 - accuracy: 0.6847
Epoch 9/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5992 - accuracy: 0.6850
Epoch 10/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5979 - accuracy: 0.6852
Epoch 11/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5969 - accuracy: 0.6862
Epoch 12/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5960 - accuracy: 0.6873
Epoch 13/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5953 - accuracy: 0.6869
Epoch 14/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5944 - accuracy: 0.6872
Epoch 15/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5939 - accuracy: 0.6872
Epoch 16/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5926 - accuracy: 0.6876
Epoch 17/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5919 - accuracy: 0.6883
Epoch 18/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5919 - accuracy: 0.6873
5697/5697 [==============================] - 0s 20us/step
Epoch 1/19
20000/20000 [==============================] - 0s 12us/step - loss: 0.6589 - accuracy: 0.6284
Epoch 2/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6195 - accuracy: 0.6766
Epoch 3/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6109 - accuracy: 0.6801
Epoch 4/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6065 - accuracy: 0.6814
Epoch 5/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6041 - accuracy: 0.6829
Epoch 6/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6017 - accuracy: 0.6834
Epoch 7/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5998 - accuracy: 0.6850
Epoch 8/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5985 - accuracy: 0.6843
Epoch 9/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5973 - accuracy: 0.6847
Epoch 10/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5958 - accuracy: 0.6867
Epoch 11/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5951 - accuracy: 0.6855
Epoch 12/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5944 - accuracy: 0.6865
Epoch 13/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5929 - accuracy: 0.6881
Epoch 14/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5924 - accuracy: 0.6882
Epoch 15/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5915 - accuracy: 0.6885
Epoch 16/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5910 - accuracy: 0.6879
Epoch 17/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5900 - accuracy: 0.6898
Epoch 18/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5894 - accuracy: 0.6885
Epoch 19/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5882 - accuracy: 0.6899
5697/5697 [==============================] - 0s 19us/step
Epoch 1/20
20000/20000 [==============================] - 0s 11us/step - loss: 0.6782 - accuracy: 0.6047
Epoch 2/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6262 - accuracy: 0.6765
Epoch 3/20
20000/20000 [==============================] - 0s 6us/step - loss: 0.6146 - accuracy: 0.6806
Epoch 4/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6088 - accuracy: 0.6812
Epoch 5/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6055 - accuracy: 0.6827
Epoch 6/20
20000/20000 [==============================] - 0s 4us/step - loss: 0.6032 - accuracy: 0.6840
Epoch 7/20
20000/20000 [==============================] - 0s 4us/step - loss: 0.6010 - accuracy: 0.6849
Epoch 8/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5990 - accuracy: 0.6862
Epoch 9/20
20000/20000 [==============================] - 0s 12us/step - loss: 0.5982 - accuracy: 0.6863
Epoch 10/20
20000/20000 [==============================] - 0s 7us/step - loss: 0.5969 - accuracy: 0.6867
Epoch 11/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5955 - accuracy: 0.6864
Epoch 12/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5947 - accuracy: 0.6863
Epoch 13/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5941 - accuracy: 0.6874
Epoch 14/20
20000/20000 [==============================] - 0s 6us/step - loss: 0.5928 - accuracy: 0.6878
Epoch 15/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5918 - accuracy: 0.6878
Epoch 16/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5908 - accuracy: 0.6888
Epoch 17/20
20000/20000 [==============================] - 0s 6us/step - loss: 0.5901 - accuracy: 0.6891
Epoch 18/20
20000/20000 [==============================] - 0s 7us/step - loss: 0.5896 - accuracy: 0.6891
Epoch 19/20
20000/20000 [==============================] - 0s 6us/step - loss: 0.5884 - accuracy: 0.6894
Epoch 20/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5877 - accuracy: 0.6881
5697/5697 [==============================] - 0s 19us/step
Epoch 1/21
20000/20000 [==============================] - 0s 12us/step - loss: 0.6736 - accuracy: 0.6066
Epoch 2/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6246 - accuracy: 0.6744
Epoch 3/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6124 - accuracy: 0.6805
Epoch 4/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6075 - accuracy: 0.6816
Epoch 5/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6046 - accuracy: 0.6831
Epoch 6/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6023 - accuracy: 0.6841
Epoch 7/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6007 - accuracy: 0.6844
Epoch 8/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5994 - accuracy: 0.6853
Epoch 9/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5976 - accuracy: 0.6860
Epoch 10/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5967 - accuracy: 0.6858
Epoch 11/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5955 - accuracy: 0.6871
Epoch 12/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5947 - accuracy: 0.6866
Epoch 13/21
20000/20000 [==============================] - 0s 9us/step - loss: 0.5936 - accuracy: 0.6872
Epoch 14/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5931 - accuracy: 0.6874
Epoch 15/21
20000/20000 [==============================] - 0s 9us/step - loss: 0.5921 - accuracy: 0.6881
Epoch 16/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5914 - accuracy: 0.6877
Epoch 17/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5908 - accuracy: 0.6880
Epoch 18/21
20000/20000 [==============================] - 0s 7us/step - loss: 0.5898 - accuracy: 0.6891
Epoch 19/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5898 - accuracy: 0.6892
Epoch 20/21
20000/20000 [==============================] - 0s 8us/step - loss: 0.5889 - accuracy: 0.6889
Epoch 21/21
20000/20000 [==============================] - 0s 7us/step - loss: 0.5878 - accuracy: 0.6902
5697/5697 [==============================] - 0s 24us/step
Epoch 1/22
20000/20000 [==============================] - 0s 11us/step - loss: 0.6920 - accuracy: 0.5980
Epoch 2/22
20000/20000 [==============================] - 0s 6us/step - loss: 0.6287 - accuracy: 0.6721
Epoch 3/22
20000/20000 [==============================] - 0s 6us/step - loss: 0.6142 - accuracy: 0.6813
Epoch 4/22
20000/20000 [==============================] - 0s 4us/step - loss: 0.6086 - accuracy: 0.6827
Epoch 5/22
20000/20000 [==============================] - 0s 6us/step - loss: 0.6052 - accuracy: 0.6833
Epoch 6/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6028 - accuracy: 0.6837
Epoch 7/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6006 - accuracy: 0.6832
Epoch 8/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5995 - accuracy: 0.6851
Epoch 9/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5982 - accuracy: 0.6852
Epoch 10/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5970 - accuracy: 0.6862
Epoch 11/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5959 - accuracy: 0.6852
Epoch 12/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5946 - accuracy: 0.6869
Epoch 13/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5942 - accuracy: 0.6862
Epoch 14/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5932 - accuracy: 0.6872
Epoch 15/22
20000/20000 [==============================] - 0s 6us/step - loss: 0.5923 - accuracy: 0.6865
Epoch 16/22
20000/20000 [==============================] - 0s 6us/step - loss: 0.5917 - accuracy: 0.6879
Epoch 17/22
20000/20000 [==============================] - 0s 6us/step - loss: 0.5906 - accuracy: 0.6888
Epoch 18/22
20000/20000 [==============================] - 0s 6us/step - loss: 0.5903 - accuracy: 0.6890
Epoch 19/22
20000/20000 [==============================] - 0s 6us/step - loss: 0.5893 - accuracy: 0.6890
Epoch 20/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5885 - accuracy: 0.6892
Epoch 21/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5878 - accuracy: 0.6895
Epoch 22/22
20000/20000 [==============================] - 0s 6us/step - loss: 0.5872 - accuracy: 0.6899
5697/5697 [==============================] - 0s 22us/step
Epoch 1/23
20000/20000 [==============================] - 0s 13us/step - loss: 0.6522 - accuracy: 0.6363
Epoch 2/23
20000/20000 [==============================] - 0s 6us/step - loss: 0.6182 - accuracy: 0.6804
Epoch 3/23
20000/20000 [==============================] - 0s 6us/step - loss: 0.6101 - accuracy: 0.6817
Epoch 4/23
20000/20000 [==============================] - 0s 6us/step - loss: 0.6066 - accuracy: 0.6827
Epoch 5/23
20000/20000 [==============================] - 0s 6us/step - loss: 0.6040 - accuracy: 0.6827
Epoch 6/23
20000/20000 [==============================] - 0s 6us/step - loss: 0.6025 - accuracy: 0.6834: 0s - loss: 0.5944 - accuracy: 0.
Epoch 7/23
20000/20000 [==============================] - 0s 6us/step - loss: 0.6010 - accuracy: 0.6844
Epoch 8/23
20000/20000 [==============================] - 0s 9us/step - loss: 0.5997 - accuracy: 0.6845
Epoch 9/23
20000/20000 [==============================] - 0s 8us/step - loss: 0.5986 - accuracy: 0.6845
Epoch 10/23
20000/20000 [==============================] - 0s 7us/step - loss: 0.5976 - accuracy: 0.6855
Epoch 11/23
20000/20000 [==============================] - 0s 7us/step - loss: 0.5964 - accuracy: 0.6851
Epoch 12/23
20000/20000 [==============================] - 0s 7us/step - loss: 0.5957 - accuracy: 0.6855
Epoch 13/23
20000/20000 [==============================] - 0s 10us/step - loss: 0.5948 - accuracy: 0.6859
Epoch 14/23
20000/20000 [==============================] - 0s 7us/step - loss: 0.5940 - accuracy: 0.6862
Epoch 15/23
20000/20000 [==============================] - 0s 8us/step - loss: 0.5935 - accuracy: 0.6863
Epoch 16/23
20000/20000 [==============================] - 0s 13us/step - loss: 0.5924 - accuracy: 0.6872
Epoch 17/23
20000/20000 [==============================] - 0s 8us/step - loss: 0.5920 - accuracy: 0.6865
Epoch 18/23
20000/20000 [==============================] - 0s 8us/step - loss: 0.5912 - accuracy: 0.6876
Epoch 19/23
20000/20000 [==============================] - 0s 7us/step - loss: 0.5904 - accuracy: 0.6883
Epoch 20/23
20000/20000 [==============================] - 0s 8us/step - loss: 0.5898 - accuracy: 0.6881
Epoch 21/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5890 - accuracy: 0.6899
Epoch 22/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5886 - accuracy: 0.6890
Epoch 23/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5878 - accuracy: 0.6885
5697/5697 [==============================] - 0s 18us/step
Epoch 1/24
20000/20000 [==============================] - 0s 12us/step - loss: 0.6713 - accuracy: 0.6091
Epoch 2/24
20000/20000 [==============================] - 0s 6us/step - loss: 0.6223 - accuracy: 0.6765
Epoch 3/24
20000/20000 [==============================] - 0s 6us/step - loss: 0.6119 - accuracy: 0.6785
Epoch 4/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6080 - accuracy: 0.6799
Epoch 5/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6048 - accuracy: 0.6811
Epoch 6/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6027 - accuracy: 0.6818
Epoch 7/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6010 - accuracy: 0.6826
Epoch 8/24
20000/20000 [==============================] - 0s 6us/step - loss: 0.5993 - accuracy: 0.6834
Epoch 9/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5978 - accuracy: 0.6848
Epoch 10/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5968 - accuracy: 0.6859
Epoch 11/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5958 - accuracy: 0.6858
Epoch 12/24
20000/20000 [==============================] - 0s 6us/step - loss: 0.5946 - accuracy: 0.6868
Epoch 13/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5937 - accuracy: 0.6870
Epoch 14/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5924 - accuracy: 0.6874
Epoch 15/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5919 - accuracy: 0.6876
Epoch 16/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5914 - accuracy: 0.6873
Epoch 17/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5906 - accuracy: 0.6879
Epoch 18/24
20000/20000 [==============================] - 0s 6us/step - loss: 0.5896 - accuracy: 0.6884
Epoch 19/24
20000/20000 [==============================] - 0s 6us/step - loss: 0.5891 - accuracy: 0.6890
Epoch 20/24
20000/20000 [==============================] - 0s 6us/step - loss: 0.5887 - accuracy: 0.6899
Epoch 21/24
20000/20000 [==============================] - 0s 6us/step - loss: 0.5880 - accuracy: 0.6893
Epoch 22/24
20000/20000 [==============================] - 0s 6us/step - loss: 0.5870 - accuracy: 0.6890
Epoch 23/24
20000/20000 [==============================] - 0s 6us/step - loss: 0.5869 - accuracy: 0.6895
Epoch 24/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5860 - accuracy: 0.6903
5697/5697 [==============================] - 0s 28us/step
Epoch 1/25
20000/20000 [==============================] - 0s 12us/step - loss: 0.6595 - accuracy: 0.6281
Epoch 2/25
20000/20000 [==============================] - 0s 11us/step - loss: 0.6223 - accuracy: 0.6754
Epoch 3/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.6132 - accuracy: 0.6794
Epoch 4/25
20000/20000 [==============================] - 0s 9us/step - loss: 0.6080 - accuracy: 0.6815
Epoch 5/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.6047 - accuracy: 0.6818
Epoch 6/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6024 - accuracy: 0.6837
Epoch 7/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6006 - accuracy: 0.6834
Epoch 8/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5991 - accuracy: 0.6847
Epoch 9/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5976 - accuracy: 0.6859
Epoch 10/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5966 - accuracy: 0.6854
Epoch 11/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.5958 - accuracy: 0.6860
Epoch 12/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5949 - accuracy: 0.6854
Epoch 13/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.5938 - accuracy: 0.6856
Epoch 14/25
20000/20000 [==============================] - 0s 9us/step - loss: 0.5930 - accuracy: 0.6867
Epoch 15/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.5921 - accuracy: 0.6869
Epoch 16/25
20000/20000 [==============================] - 0s 9us/step - loss: 0.5915 - accuracy: 0.6872
Epoch 17/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.5907 - accuracy: 0.6867
Epoch 18/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5901 - accuracy: 0.6876
Epoch 19/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5889 - accuracy: 0.6877
Epoch 20/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5884 - accuracy: 0.6891
Epoch 21/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.5878 - accuracy: 0.6892
Epoch 22/25
20000/20000 [==============================] - 0s 8us/step - loss: 0.5871 - accuracy: 0.6888
Epoch 23/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5863 - accuracy: 0.6913
Epoch 24/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5861 - accuracy: 0.6902
Epoch 25/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5850 - accuracy: 0.6904
5697/5697 [==============================] - 0s 20us/step
Epoch 1/26
20000/20000 [==============================] - 0s 12us/step - loss: 0.6697 - accuracy: 0.6059
Epoch 2/26
20000/20000 [==============================] - 0s 6us/step - loss: 0.6221 - accuracy: 0.6780
Epoch 3/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6122 - accuracy: 0.6804
Epoch 4/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6079 - accuracy: 0.6817
Epoch 5/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6051 - accuracy: 0.6833
Epoch 6/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6027 - accuracy: 0.6845
Epoch 7/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6007 - accuracy: 0.6845
Epoch 8/26
20000/20000 [==============================] - 0s 6us/step - loss: 0.5994 - accuracy: 0.6845
Epoch 9/26
20000/20000 [==============================] - 0s 6us/step - loss: 0.5973 - accuracy: 0.6856
Epoch 10/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5965 - accuracy: 0.6863
Epoch 11/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5956 - accuracy: 0.6865
Epoch 12/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5948 - accuracy: 0.6867
Epoch 13/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5938 - accuracy: 0.6870
Epoch 14/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5927 - accuracy: 0.6873
Epoch 15/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5917 - accuracy: 0.6891
Epoch 16/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5911 - accuracy: 0.6887
Epoch 17/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5904 - accuracy: 0.6892
Epoch 18/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5895 - accuracy: 0.6891
Epoch 19/26
20000/20000 [==============================] - 0s 6us/step - loss: 0.5886 - accuracy: 0.6898
Epoch 20/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5882 - accuracy: 0.6902
Epoch 21/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5875 - accuracy: 0.6902
Epoch 22/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5866 - accuracy: 0.6908
Epoch 23/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5858 - accuracy: 0.6910
Epoch 24/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5856 - accuracy: 0.6909
Epoch 25/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5847 - accuracy: 0.6909
Epoch 26/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5845 - accuracy: 0.6917
5697/5697 [==============================] - 0s 24us/step
Epoch 1/27
20000/20000 [==============================] - 0s 11us/step - loss: 0.6631 - accuracy: 0.6317
Epoch 2/27
20000/20000 [==============================] - 0s 6us/step - loss: 0.6235 - accuracy: 0.6764
Epoch 3/27
20000/20000 [==============================] - 0s 6us/step - loss: 0.6130 - accuracy: 0.6809
Epoch 4/27
20000/20000 [==============================] - 0s 6us/step - loss: 0.6080 - accuracy: 0.6827
Epoch 5/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6046 - accuracy: 0.6823
Epoch 6/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6023 - accuracy: 0.6830
Epoch 7/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6008 - accuracy: 0.6834
Epoch 8/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5991 - accuracy: 0.6844
Epoch 9/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5979 - accuracy: 0.6842
Epoch 10/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5966 - accuracy: 0.6856
Epoch 11/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5955 - accuracy: 0.6857
Epoch 12/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5947 - accuracy: 0.6862
Epoch 13/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5936 - accuracy: 0.6865
Epoch 14/27
20000/20000 [==============================] - 0s 6us/step - loss: 0.5928 - accuracy: 0.6866
Epoch 15/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5920 - accuracy: 0.6866
Epoch 16/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5912 - accuracy: 0.6880
Epoch 17/27
20000/20000 [==============================] - 0s 6us/step - loss: 0.5905 - accuracy: 0.6873
Epoch 18/27
20000/20000 [==============================] - 0s 6us/step - loss: 0.5897 - accuracy: 0.6884
Epoch 19/27
20000/20000 [==============================] - 0s 6us/step - loss: 0.5897 - accuracy: 0.6880
Epoch 20/27
20000/20000 [==============================] - 0s 6us/step - loss: 0.5886 - accuracy: 0.6889
Epoch 21/27
20000/20000 [==============================] - 0s 7us/step - loss: 0.5883 - accuracy: 0.6878
Epoch 22/27
20000/20000 [==============================] - 0s 7us/step - loss: 0.5870 - accuracy: 0.6906
Epoch 23/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5866 - accuracy: 0.6891
Epoch 24/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5860 - accuracy: 0.6905
Epoch 25/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5853 - accuracy: 0.6908
Epoch 26/27
20000/20000 [==============================] - 0s 6us/step - loss: 0.5850 - accuracy: 0.6912
Epoch 27/27
20000/20000 [==============================] - 0s 6us/step - loss: 0.5843 - accuracy: 0.6906
5697/5697 [==============================] - 0s 19us/step
Epoch 1/28
20000/20000 [==============================] - 0s 11us/step - loss: 0.6670 - accuracy: 0.6166
Epoch 2/28
20000/20000 [==============================] - 0s 6us/step - loss: 0.6248 - accuracy: 0.6772
Epoch 3/28
20000/20000 [==============================] - 0s 6us/step - loss: 0.6127 - accuracy: 0.6801
Epoch 4/28
20000/20000 [==============================] - 0s 6us/step - loss: 0.6074 - accuracy: 0.6811
Epoch 5/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6045 - accuracy: 0.6830
Epoch 6/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6020 - accuracy: 0.6819
Epoch 7/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6005 - accuracy: 0.6829
Epoch 8/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5992 - accuracy: 0.6836
Epoch 9/28
20000/20000 [==============================] - 0s 6us/step - loss: 0.5977 - accuracy: 0.6844
Epoch 10/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5969 - accuracy: 0.6858
Epoch 11/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5961 - accuracy: 0.6840
Epoch 12/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5948 - accuracy: 0.6847
Epoch 13/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5941 - accuracy: 0.6858
Epoch 14/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5931 - accuracy: 0.6873
Epoch 15/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5924 - accuracy: 0.6862
Epoch 16/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5918 - accuracy: 0.6867
Epoch 17/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5912 - accuracy: 0.6866
Epoch 18/28
20000/20000 [==============================] - 0s 6us/step - loss: 0.5902 - accuracy: 0.6876
Epoch 19/28
20000/20000 [==============================] - 0s 6us/step - loss: 0.5895 - accuracy: 0.6870
Epoch 20/28
20000/20000 [==============================] - 0s 6us/step - loss: 0.5892 - accuracy: 0.6877
Epoch 21/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5887 - accuracy: 0.6880
Epoch 22/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5883 - accuracy: 0.6896
Epoch 23/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5872 - accuracy: 0.6899
Epoch 24/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5869 - accuracy: 0.6891
Epoch 25/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5860 - accuracy: 0.6884
Epoch 26/28
20000/20000 [==============================] - 0s 6us/step - loss: 0.5857 - accuracy: 0.6906
Epoch 27/28
20000/20000 [==============================] - 0s 10us/step - loss: 0.5852 - accuracy: 0.6905
Epoch 28/28
20000/20000 [==============================] - 0s 9us/step - loss: 0.5845 - accuracy: 0.6909
5697/5697 [==============================] - 0s 21us/step
Epoch 1/29
20000/20000 [==============================] - 0s 12us/step - loss: 0.6792 - accuracy: 0.6235
Epoch 2/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.6259 - accuracy: 0.6777
Epoch 3/29
20000/20000 [==============================] - 0s 9us/step - loss: 0.6127 - accuracy: 0.6816
Epoch 4/29
20000/20000 [==============================] - 0s 9us/step - loss: 0.6071 - accuracy: 0.6829
Epoch 5/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.6045 - accuracy: 0.6835
Epoch 6/29
20000/20000 [==============================] - 0s 8us/step - loss: 0.6016 - accuracy: 0.6851
Epoch 7/29
20000/20000 [==============================] - 0s 8us/step - loss: 0.6001 - accuracy: 0.6854
Epoch 8/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.5990 - accuracy: 0.6854
Epoch 9/29
20000/20000 [==============================] - 0s 9us/step - loss: 0.5977 - accuracy: 0.6868
Epoch 10/29
20000/20000 [==============================] - 0s 9us/step - loss: 0.5961 - accuracy: 0.6873
Epoch 11/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.5953 - accuracy: 0.6865
Epoch 12/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5943 - accuracy: 0.6876
Epoch 13/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5932 - accuracy: 0.6877
Epoch 14/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.5925 - accuracy: 0.6886
Epoch 15/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5915 - accuracy: 0.6889
Epoch 16/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5907 - accuracy: 0.6888
Epoch 17/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5902 - accuracy: 0.6898
Epoch 18/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5895 - accuracy: 0.6891
Epoch 19/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5886 - accuracy: 0.6910
Epoch 20/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5880 - accuracy: 0.6901
Epoch 21/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5872 - accuracy: 0.6911
Epoch 22/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5867 - accuracy: 0.6912
Epoch 23/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5860 - accuracy: 0.6901
Epoch 24/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5853 - accuracy: 0.6912
Epoch 25/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5847 - accuracy: 0.6921
Epoch 26/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5843 - accuracy: 0.6921
Epoch 27/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5833 - accuracy: 0.6937
Epoch 28/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5828 - accuracy: 0.6926
Epoch 29/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5822 - accuracy: 0.6928
5697/5697 [==============================] - 0s 21us/step
Epoch 1/30
20000/20000 [==============================] - 0s 12us/step - loss: 0.6559 - accuracy: 0.6293
Epoch 2/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6193 - accuracy: 0.6762
Epoch 3/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.6116 - accuracy: 0.6805
Epoch 4/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.6078 - accuracy: 0.6818
Epoch 5/30
20000/20000 [==============================] - 0s 7us/step - loss: 0.6052 - accuracy: 0.6820
Epoch 6/30
20000/20000 [==============================] - 0s 8us/step - loss: 0.6027 - accuracy: 0.6837
Epoch 7/30
20000/20000 [==============================] - 0s 7us/step - loss: 0.6008 - accuracy: 0.6847
Epoch 8/30
20000/20000 [==============================] - 0s 10us/step - loss: 0.5992 - accuracy: 0.6857
Epoch 9/30
20000/20000 [==============================] - 0s 7us/step - loss: 0.5980 - accuracy: 0.6844
Epoch 10/30
20000/20000 [==============================] - 0s 7us/step - loss: 0.5970 - accuracy: 0.6859
Epoch 11/30
20000/20000 [==============================] - 0s 10us/step - loss: 0.5959 - accuracy: 0.6869
Epoch 12/30
20000/20000 [==============================] - 0s 7us/step - loss: 0.5948 - accuracy: 0.6874
Epoch 13/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.5941 - accuracy: 0.6878
Epoch 14/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5932 - accuracy: 0.6880
Epoch 15/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5922 - accuracy: 0.6877
Epoch 16/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5916 - accuracy: 0.6884
Epoch 17/30
20000/20000 [==============================] - 0s 9us/step - loss: 0.5906 - accuracy: 0.6884
Epoch 18/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.5902 - accuracy: 0.6883
Epoch 19/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5894 - accuracy: 0.6891
Epoch 20/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5889 - accuracy: 0.6887
Epoch 21/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5881 - accuracy: 0.6899
Epoch 22/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5874 - accuracy: 0.6891
Epoch 23/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5869 - accuracy: 0.6902
Epoch 24/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5863 - accuracy: 0.6898
Epoch 25/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.5856 - accuracy: 0.6898
Epoch 26/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5849 - accuracy: 0.6903
Epoch 27/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5845 - accuracy: 0.6902
Epoch 28/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5839 - accuracy: 0.6909
Epoch 29/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5832 - accuracy: 0.6909
Epoch 30/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5828 - accuracy: 0.6915
5697/5697 [==============================] - 0s 27us/step
Epoch 1/7
20000/20000 [==============================] - 0s 13us/step - loss: 0.6478 - accuracy: 0.6465
Epoch 2/7
20000/20000 [==============================] - 0s 6us/step - loss: 0.6162 - accuracy: 0.6804
Epoch 3/7
20000/20000 [==============================] - 0s 7us/step - loss: 0.6091 - accuracy: 0.6822
Epoch 4/7
20000/20000 [==============================] - 0s 7us/step - loss: 0.6058 - accuracy: 0.6830
Epoch 5/7
20000/20000 [==============================] - 0s 6us/step - loss: 0.6029 - accuracy: 0.6840
Epoch 6/7
20000/20000 [==============================] - 0s 9us/step - loss: 0.6008 - accuracy: 0.6840: 0s - loss: 0.6054 - accuracy: 
Epoch 7/7
20000/20000 [==============================] - 0s 10us/step - loss: 0.5990 - accuracy: 0.6848
5697/5697 [==============================] - 0s 20us/step
Epoch 1/8
20000/20000 [==============================] - 0s 12us/step - loss: 0.6587 - accuracy: 0.6296
Epoch 2/8
20000/20000 [==============================] - 0s 6us/step - loss: 0.6199 - accuracy: 0.6795
Epoch 3/8
20000/20000 [==============================] - 0s 7us/step - loss: 0.6123 - accuracy: 0.6798
Epoch 4/8
20000/20000 [==============================] - 0s 5us/step - loss: 0.6071 - accuracy: 0.6822
Epoch 5/8
20000/20000 [==============================] - 0s 5us/step - loss: 0.6042 - accuracy: 0.6830
Epoch 6/8
20000/20000 [==============================] - 0s 5us/step - loss: 0.6026 - accuracy: 0.6848
Epoch 7/8
20000/20000 [==============================] - 0s 5us/step - loss: 0.5999 - accuracy: 0.6833
Epoch 8/8
20000/20000 [==============================] - 0s 6us/step - loss: 0.5987 - accuracy: 0.6851
5697/5697 [==============================] - 0s 23us/step
Epoch 1/9
20000/20000 [==============================] - 0s 12us/step - loss: 0.6520 - accuracy: 0.6418
Epoch 2/9
20000/20000 [==============================] - 0s 6us/step - loss: 0.6176 - accuracy: 0.6780
Epoch 3/9
20000/20000 [==============================] - 0s 6us/step - loss: 0.6096 - accuracy: 0.6809
Epoch 4/9
20000/20000 [==============================] - 0s 6us/step - loss: 0.6056 - accuracy: 0.6817
Epoch 5/9
20000/20000 [==============================] - 0s 7us/step - loss: 0.6029 - accuracy: 0.6830
Epoch 6/9
20000/20000 [==============================] - 0s 6us/step - loss: 0.6009 - accuracy: 0.6841
Epoch 7/9
20000/20000 [==============================] - 0s 6us/step - loss: 0.5991 - accuracy: 0.6838
Epoch 8/9
20000/20000 [==============================] - 0s 6us/step - loss: 0.5978 - accuracy: 0.6848
Epoch 9/9
20000/20000 [==============================] - 0s 6us/step - loss: 0.5961 - accuracy: 0.6850
5697/5697 [==============================] - 0s 21us/step
Epoch 1/10
20000/20000 [==============================] - 0s 12us/step - loss: 0.6619 - accuracy: 0.6191
Epoch 2/10
20000/20000 [==============================] - 0s 7us/step - loss: 0.6209 - accuracy: 0.6783
Epoch 3/10
20000/20000 [==============================] - 0s 7us/step - loss: 0.6109 - accuracy: 0.6827
Epoch 4/10
20000/20000 [==============================] - 0s 7us/step - loss: 0.6062 - accuracy: 0.6833
Epoch 5/10
20000/20000 [==============================] - 0s 7us/step - loss: 0.6037 - accuracy: 0.6830
Epoch 6/10
20000/20000 [==============================] - 0s 6us/step - loss: 0.6017 - accuracy: 0.6847
Epoch 7/10
20000/20000 [==============================] - 0s 6us/step - loss: 0.6000 - accuracy: 0.6863
Epoch 8/10
20000/20000 [==============================] - 0s 6us/step - loss: 0.5988 - accuracy: 0.6854
Epoch 9/10
20000/20000 [==============================] - 0s 6us/step - loss: 0.5975 - accuracy: 0.6866
Epoch 10/10
20000/20000 [==============================] - 0s 6us/step - loss: 0.5964 - accuracy: 0.6859
5697/5697 [==============================] - 0s 18us/step
Epoch 1/11
20000/20000 [==============================] - 0s 12us/step - loss: 0.6499 - accuracy: 0.6389
Epoch 2/11
20000/20000 [==============================] - 0s 6us/step - loss: 0.6163 - accuracy: 0.6781
Epoch 3/11
20000/20000 [==============================] - 0s 6us/step - loss: 0.6087 - accuracy: 0.6810
Epoch 4/11
20000/20000 [==============================] - 0s 6us/step - loss: 0.6053 - accuracy: 0.6816
Epoch 5/11
20000/20000 [==============================] - 0s 6us/step - loss: 0.6028 - accuracy: 0.6827
Epoch 6/11
20000/20000 [==============================] - 0s 7us/step - loss: 0.6004 - accuracy: 0.6845
Epoch 7/11
20000/20000 [==============================] - 0s 7us/step - loss: 0.5995 - accuracy: 0.6840
Epoch 8/11
20000/20000 [==============================] - 0s 6us/step - loss: 0.5978 - accuracy: 0.6860
Epoch 9/11
20000/20000 [==============================] - 0s 6us/step - loss: 0.5963 - accuracy: 0.6854
Epoch 10/11
20000/20000 [==============================] - 0s 6us/step - loss: 0.5956 - accuracy: 0.6855
Epoch 11/11
20000/20000 [==============================] - 0s 6us/step - loss: 0.5944 - accuracy: 0.6862
5697/5697 [==============================] - 0s 20us/step
Epoch 1/12
20000/20000 [==============================] - 0s 12us/step - loss: 0.6560 - accuracy: 0.6302
Epoch 2/12
20000/20000 [==============================] - 0s 6us/step - loss: 0.6185 - accuracy: 0.6772
Epoch 3/12
20000/20000 [==============================] - 0s 6us/step - loss: 0.6100 - accuracy: 0.6807
Epoch 4/12
20000/20000 [==============================] - 0s 7us/step - loss: 0.6063 - accuracy: 0.6819
Epoch 5/12
20000/20000 [==============================] - 0s 7us/step - loss: 0.6036 - accuracy: 0.6834
Epoch 6/12
20000/20000 [==============================] - 0s 6us/step - loss: 0.6015 - accuracy: 0.6843
Epoch 7/12
20000/20000 [==============================] - 0s 9us/step - loss: 0.6000 - accuracy: 0.6848
Epoch 8/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.5988 - accuracy: 0.6843
Epoch 9/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.5972 - accuracy: 0.6854
Epoch 10/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.5957 - accuracy: 0.6858
Epoch 11/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.5950 - accuracy: 0.6855
Epoch 12/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.5937 - accuracy: 0.6880
5697/5697 [==============================] - 0s 18us/step
Epoch 1/13
20000/20000 [==============================] - 0s 11us/step - loss: 0.6582 - accuracy: 0.6419
Epoch 2/13
20000/20000 [==============================] - 0s 6us/step - loss: 0.6214 - accuracy: 0.6791
Epoch 3/13
20000/20000 [==============================] - 0s 6us/step - loss: 0.6130 - accuracy: 0.6810
Epoch 4/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6079 - accuracy: 0.6823
Epoch 5/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6049 - accuracy: 0.6830
Epoch 6/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6035 - accuracy: 0.6841
Epoch 7/13
20000/20000 [==============================] - 0s 8us/step - loss: 0.6015 - accuracy: 0.6849
Epoch 8/13
20000/20000 [==============================] - 0s 8us/step - loss: 0.5997 - accuracy: 0.6862
Epoch 9/13
20000/20000 [==============================] - 0s 8us/step - loss: 0.5981 - accuracy: 0.6859
Epoch 10/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.5977 - accuracy: 0.6859
Epoch 11/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.5967 - accuracy: 0.6873
Epoch 12/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.5954 - accuracy: 0.6867
Epoch 13/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.5946 - accuracy: 0.6870
5697/5697 [==============================] - 0s 19us/step
Epoch 1/14
20000/20000 [==============================] - 0s 12us/step - loss: 0.6527 - accuracy: 0.6360
Epoch 2/14
20000/20000 [==============================] - 0s 6us/step - loss: 0.6190 - accuracy: 0.6769
Epoch 3/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6109 - accuracy: 0.6805
Epoch 4/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6067 - accuracy: 0.6823
Epoch 5/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6037 - accuracy: 0.6836
Epoch 6/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.6014 - accuracy: 0.6843
Epoch 7/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.5995 - accuracy: 0.6849
Epoch 8/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.5980 - accuracy: 0.6847
Epoch 9/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.5968 - accuracy: 0.6848
Epoch 10/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.5954 - accuracy: 0.6858
Epoch 11/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.5940 - accuracy: 0.6866
Epoch 12/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.5929 - accuracy: 0.6867
Epoch 13/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.5915 - accuracy: 0.6878
Epoch 14/14
20000/20000 [==============================] - 0s 5us/step - loss: 0.5909 - accuracy: 0.6865
5697/5697 [==============================] - 0s 19us/step
Epoch 1/15
20000/20000 [==============================] - 0s 11us/step - loss: 0.6604 - accuracy: 0.6257
Epoch 2/15
20000/20000 [==============================] - 0s 6us/step - loss: 0.6206 - accuracy: 0.6771
Epoch 3/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6118 - accuracy: 0.6793
Epoch 4/15
20000/20000 [==============================] - 0s 6us/step - loss: 0.6072 - accuracy: 0.6813
Epoch 5/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6046 - accuracy: 0.6805
Epoch 6/15
20000/20000 [==============================] - 0s 6us/step - loss: 0.6027 - accuracy: 0.6826
Epoch 7/15
20000/20000 [==============================] - 0s 6us/step - loss: 0.6007 - accuracy: 0.6831
Epoch 8/15
20000/20000 [==============================] - 0s 6us/step - loss: 0.5998 - accuracy: 0.6842
Epoch 9/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.5980 - accuracy: 0.6841
Epoch 10/15
20000/20000 [==============================] - 0s 6us/step - loss: 0.5971 - accuracy: 0.6844
Epoch 11/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.5960 - accuracy: 0.6844
Epoch 12/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.5950 - accuracy: 0.6847
Epoch 13/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.5940 - accuracy: 0.6865
Epoch 14/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.5928 - accuracy: 0.6864
Epoch 15/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.5922 - accuracy: 0.6877
5697/5697 [==============================] - 0s 18us/step
Epoch 1/16
20000/20000 [==============================] - 0s 11us/step - loss: 0.6576 - accuracy: 0.6284
Epoch 2/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6205 - accuracy: 0.6751
Epoch 3/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6118 - accuracy: 0.6802
Epoch 4/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6068 - accuracy: 0.6813
Epoch 5/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6041 - accuracy: 0.6825
Epoch 6/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.6012 - accuracy: 0.6830
Epoch 7/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.5992 - accuracy: 0.6848
Epoch 8/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.5974 - accuracy: 0.6871
Epoch 9/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.5958 - accuracy: 0.6863
Epoch 10/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.5943 - accuracy: 0.6866
Epoch 11/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.5937 - accuracy: 0.6874
Epoch 12/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.5924 - accuracy: 0.6872
Epoch 13/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.5907 - accuracy: 0.6883
Epoch 14/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.5899 - accuracy: 0.6885
Epoch 15/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.5892 - accuracy: 0.6876
Epoch 16/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.5880 - accuracy: 0.6895
5697/5697 [==============================] - 0s 18us/step
Epoch 1/17
20000/20000 [==============================] - 0s 11us/step - loss: 0.6633 - accuracy: 0.6271
Epoch 2/17
20000/20000 [==============================] - 0s 6us/step - loss: 0.6205 - accuracy: 0.6774
Epoch 3/17
20000/20000 [==============================] - 0s 6us/step - loss: 0.6114 - accuracy: 0.6801
Epoch 4/17
20000/20000 [==============================] - 0s 6us/step - loss: 0.6070 - accuracy: 0.6822
Epoch 5/17
20000/20000 [==============================] - 0s 6us/step - loss: 0.6043 - accuracy: 0.6830
Epoch 6/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6021 - accuracy: 0.6834
Epoch 7/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6005 - accuracy: 0.6838
Epoch 8/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.5990 - accuracy: 0.6844
Epoch 9/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.5975 - accuracy: 0.6851
Epoch 10/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.5965 - accuracy: 0.6850
Epoch 11/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.5952 - accuracy: 0.6862
Epoch 12/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.5945 - accuracy: 0.6876
Epoch 13/17
20000/20000 [==============================] - 0s 6us/step - loss: 0.5936 - accuracy: 0.6866
Epoch 14/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.5924 - accuracy: 0.6878
Epoch 15/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.5919 - accuracy: 0.6876
Epoch 16/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.5909 - accuracy: 0.6872
Epoch 17/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.5902 - accuracy: 0.6880
5697/5697 [==============================] - 0s 19us/step
Epoch 1/18
20000/20000 [==============================] - 0s 11us/step - loss: 0.6609 - accuracy: 0.6174
Epoch 2/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.6194 - accuracy: 0.6777
Epoch 3/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.6098 - accuracy: 0.6812
Epoch 4/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.6059 - accuracy: 0.6823
Epoch 5/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.6034 - accuracy: 0.6832
Epoch 6/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.6016 - accuracy: 0.6845
Epoch 7/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.5998 - accuracy: 0.6861
Epoch 8/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.5990 - accuracy: 0.6859
Epoch 9/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.5974 - accuracy: 0.6859
Epoch 10/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5962 - accuracy: 0.6876
Epoch 11/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5953 - accuracy: 0.6872
Epoch 12/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5946 - accuracy: 0.6881
Epoch 13/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5939 - accuracy: 0.6881
Epoch 14/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5928 - accuracy: 0.6881
Epoch 15/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.5918 - accuracy: 0.6885
Epoch 16/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5914 - accuracy: 0.6892
Epoch 17/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5902 - accuracy: 0.6877
Epoch 18/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5896 - accuracy: 0.6881
5697/5697 [==============================] - 0s 19us/step
Epoch 1/19
20000/20000 [==============================] - 0s 11us/step - loss: 0.6562 - accuracy: 0.6342
Epoch 2/19
20000/20000 [==============================] - 0s 6us/step - loss: 0.6193 - accuracy: 0.6789
Epoch 3/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6097 - accuracy: 0.6811
Epoch 4/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6058 - accuracy: 0.6825
Epoch 5/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6027 - accuracy: 0.6831
Epoch 6/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6007 - accuracy: 0.6827
Epoch 7/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5993 - accuracy: 0.6840
Epoch 8/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5976 - accuracy: 0.6848
Epoch 9/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5964 - accuracy: 0.6854
Epoch 10/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5951 - accuracy: 0.6847
Epoch 11/19
20000/20000 [==============================] - 0s 6us/step - loss: 0.5940 - accuracy: 0.6857
Epoch 12/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5931 - accuracy: 0.6859
Epoch 13/19
20000/20000 [==============================] - 0s 6us/step - loss: 0.5921 - accuracy: 0.6871
Epoch 14/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5917 - accuracy: 0.6864
Epoch 15/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5904 - accuracy: 0.6880
Epoch 16/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5895 - accuracy: 0.6880
Epoch 17/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5892 - accuracy: 0.6873
Epoch 18/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5879 - accuracy: 0.6880
Epoch 19/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5873 - accuracy: 0.6894
5697/5697 [==============================] - 0s 19us/step
Epoch 1/20
20000/20000 [==============================] - 0s 11us/step - loss: 0.6740 - accuracy: 0.6119
Epoch 2/20
20000/20000 [==============================] - 0s 6us/step - loss: 0.6200 - accuracy: 0.6755
Epoch 3/20
20000/20000 [==============================] - 0s 6us/step - loss: 0.6115 - accuracy: 0.6802
Epoch 4/20
20000/20000 [==============================] - 0s 6us/step - loss: 0.6076 - accuracy: 0.6810
Epoch 5/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6049 - accuracy: 0.6830
Epoch 6/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6023 - accuracy: 0.6837
Epoch 7/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6005 - accuracy: 0.6838
Epoch 8/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5992 - accuracy: 0.6847
Epoch 9/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5976 - accuracy: 0.6844
Epoch 10/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5963 - accuracy: 0.6859
Epoch 11/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5951 - accuracy: 0.6856
Epoch 12/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5943 - accuracy: 0.6862
Epoch 13/20
20000/20000 [==============================] - 0s 6us/step - loss: 0.5936 - accuracy: 0.6867
Epoch 14/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5925 - accuracy: 0.6867
Epoch 15/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5915 - accuracy: 0.6874
Epoch 16/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5909 - accuracy: 0.6888
Epoch 17/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5900 - accuracy: 0.6881
Epoch 18/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5894 - accuracy: 0.6880
Epoch 19/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5886 - accuracy: 0.6889
Epoch 20/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5874 - accuracy: 0.6895
5697/5697 [==============================] - 0s 21us/step
Epoch 1/21
20000/20000 [==============================] - 0s 11us/step - loss: 0.6510 - accuracy: 0.6492
Epoch 2/21
20000/20000 [==============================] - 0s 6us/step - loss: 0.6177 - accuracy: 0.6779
Epoch 3/21
20000/20000 [==============================] - 0s 6us/step - loss: 0.6098 - accuracy: 0.6801
Epoch 4/21
20000/20000 [==============================] - 0s 6us/step - loss: 0.6057 - accuracy: 0.6819
Epoch 5/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6026 - accuracy: 0.6827
Epoch 6/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6012 - accuracy: 0.6831
Epoch 7/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5993 - accuracy: 0.6838
Epoch 8/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5982 - accuracy: 0.6845
Epoch 9/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5968 - accuracy: 0.6845
Epoch 10/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5955 - accuracy: 0.6853
Epoch 11/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5939 - accuracy: 0.6859
Epoch 12/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5936 - accuracy: 0.6857
Epoch 13/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5925 - accuracy: 0.6866
Epoch 14/21
20000/20000 [==============================] - 0s 6us/step - loss: 0.5920 - accuracy: 0.6875
Epoch 15/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5905 - accuracy: 0.6875
Epoch 16/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5901 - accuracy: 0.6890
Epoch 17/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5892 - accuracy: 0.6884
Epoch 18/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5889 - accuracy: 0.6885
Epoch 19/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5885 - accuracy: 0.6895
Epoch 20/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5872 - accuracy: 0.6892
Epoch 21/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5863 - accuracy: 0.6908
5697/5697 [==============================] - 0s 20us/step
Epoch 1/22
20000/20000 [==============================] - 0s 12us/step - loss: 0.6512 - accuracy: 0.6413
Epoch 2/22
20000/20000 [==============================] - 0s 6us/step - loss: 0.6175 - accuracy: 0.6770
Epoch 3/22
20000/20000 [==============================] - 0s 6us/step - loss: 0.6099 - accuracy: 0.6812
Epoch 4/22
20000/20000 [==============================] - 0s 6us/step - loss: 0.6059 - accuracy: 0.6837
Epoch 5/22
20000/20000 [==============================] - 0s 6us/step - loss: 0.6037 - accuracy: 0.6828
Epoch 6/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6019 - accuracy: 0.6834
Epoch 7/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6002 - accuracy: 0.6836
Epoch 8/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5984 - accuracy: 0.6858
Epoch 9/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5968 - accuracy: 0.6868
Epoch 10/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5960 - accuracy: 0.6863
Epoch 11/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5947 - accuracy: 0.6868
Epoch 12/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5939 - accuracy: 0.6874
Epoch 13/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5930 - accuracy: 0.6876
Epoch 14/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5919 - accuracy: 0.6872
Epoch 15/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5911 - accuracy: 0.6897
Epoch 16/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5901 - accuracy: 0.6888
Epoch 17/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5895 - accuracy: 0.6898
Epoch 18/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5893 - accuracy: 0.6898
Epoch 19/22
20000/20000 [==============================] - 0s 6us/step - loss: 0.5884 - accuracy: 0.6888
Epoch 20/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5868 - accuracy: 0.6908
Epoch 21/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5866 - accuracy: 0.6915
Epoch 22/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5858 - accuracy: 0.6901
5697/5697 [==============================] - 0s 18us/step
Epoch 1/23
20000/20000 [==============================] - 0s 11us/step - loss: 0.6587 - accuracy: 0.6322
Epoch 2/23
20000/20000 [==============================] - 0s 6us/step - loss: 0.6197 - accuracy: 0.6794
Epoch 3/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6103 - accuracy: 0.6806
Epoch 4/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6063 - accuracy: 0.6824
Epoch 5/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6037 - accuracy: 0.6828
Epoch 6/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6016 - accuracy: 0.6832
Epoch 7/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5995 - accuracy: 0.6845
Epoch 8/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5979 - accuracy: 0.6845
Epoch 9/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5963 - accuracy: 0.6854
Epoch 10/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5954 - accuracy: 0.6862
Epoch 11/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5940 - accuracy: 0.6869
Epoch 12/23
20000/20000 [==============================] - 0s 6us/step - loss: 0.5932 - accuracy: 0.6870
Epoch 13/23
20000/20000 [==============================] - 0s 6us/step - loss: 0.5921 - accuracy: 0.6870
Epoch 14/23
20000/20000 [==============================] - 0s 6us/step - loss: 0.5910 - accuracy: 0.6889
Epoch 15/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5903 - accuracy: 0.6884
Epoch 16/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5893 - accuracy: 0.6887
Epoch 17/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5886 - accuracy: 0.6880
Epoch 18/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5880 - accuracy: 0.6903
Epoch 19/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5868 - accuracy: 0.6907
Epoch 20/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5866 - accuracy: 0.6906
Epoch 21/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5859 - accuracy: 0.6905
Epoch 22/23
20000/20000 [==============================] - 0s 6us/step - loss: 0.5851 - accuracy: 0.6916
Epoch 23/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5841 - accuracy: 0.6913
5697/5697 [==============================] - 0s 20us/step
Epoch 1/24
20000/20000 [==============================] - 0s 11us/step - loss: 0.6485 - accuracy: 0.6475
Epoch 2/24
20000/20000 [==============================] - 0s 6us/step - loss: 0.6169 - accuracy: 0.6783
Epoch 3/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6095 - accuracy: 0.6822
Epoch 4/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6059 - accuracy: 0.6834
Epoch 5/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6036 - accuracy: 0.6838
Epoch 6/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6018 - accuracy: 0.6842
Epoch 7/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5991 - accuracy: 0.6855
Epoch 8/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5983 - accuracy: 0.6847
Epoch 9/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5971 - accuracy: 0.6859
Epoch 10/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5960 - accuracy: 0.6862
Epoch 11/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5945 - accuracy: 0.6874
Epoch 12/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5942 - accuracy: 0.6869
Epoch 13/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5929 - accuracy: 0.6880
Epoch 14/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5919 - accuracy: 0.6892
Epoch 15/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5915 - accuracy: 0.6885
Epoch 16/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5903 - accuracy: 0.6891
Epoch 17/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5898 - accuracy: 0.6891
Epoch 18/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5893 - accuracy: 0.6895
Epoch 19/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5880 - accuracy: 0.6901
Epoch 20/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5874 - accuracy: 0.6905
Epoch 21/24
20000/20000 [==============================] - 0s 6us/step - loss: 0.5867 - accuracy: 0.6901
Epoch 22/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5860 - accuracy: 0.6916
Epoch 23/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5852 - accuracy: 0.6920
Epoch 24/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5848 - accuracy: 0.6916
5697/5697 [==============================] - 0s 20us/step
Epoch 1/25
20000/20000 [==============================] - 0s 11us/step - loss: 0.6575 - accuracy: 0.6276
Epoch 2/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.6179 - accuracy: 0.6787
Epoch 3/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.6092 - accuracy: 0.6811
Epoch 4/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.6046 - accuracy: 0.6829
Epoch 5/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.6025 - accuracy: 0.6833
Epoch 6/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.6003 - accuracy: 0.6841
Epoch 7/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5984 - accuracy: 0.6848
Epoch 8/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.5971 - accuracy: 0.6853
Epoch 9/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.5955 - accuracy: 0.6862
Epoch 10/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.5945 - accuracy: 0.6867
Epoch 11/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5933 - accuracy: 0.6869
Epoch 12/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5922 - accuracy: 0.6873
Epoch 13/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5913 - accuracy: 0.6883
Epoch 14/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5902 - accuracy: 0.6891
Epoch 15/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5893 - accuracy: 0.6891
Epoch 16/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5886 - accuracy: 0.6896
Epoch 17/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5876 - accuracy: 0.6901
Epoch 18/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.5867 - accuracy: 0.6910
Epoch 19/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5861 - accuracy: 0.6920
Epoch 20/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5851 - accuracy: 0.6919
Epoch 21/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.5846 - accuracy: 0.6916
Epoch 22/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5838 - accuracy: 0.6923
Epoch 23/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5832 - accuracy: 0.6927
Epoch 24/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5824 - accuracy: 0.6926
Epoch 25/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5819 - accuracy: 0.6939
5697/5697 [==============================] - 0s 18us/step
Epoch 1/26
20000/20000 [==============================] - 0s 12us/step - loss: 0.6547 - accuracy: 0.6352
Epoch 2/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6197 - accuracy: 0.6781
Epoch 3/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6118 - accuracy: 0.6823
Epoch 4/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6076 - accuracy: 0.6827
Epoch 5/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6052 - accuracy: 0.6837
Epoch 6/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6029 - accuracy: 0.6827
Epoch 7/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6009 - accuracy: 0.6837
Epoch 8/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5992 - accuracy: 0.6843
Epoch 9/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5983 - accuracy: 0.6848
Epoch 10/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5970 - accuracy: 0.6859
Epoch 11/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5955 - accuracy: 0.6867
Epoch 12/26
20000/20000 [==============================] - 0s 6us/step - loss: 0.5951 - accuracy: 0.6865
Epoch 13/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5937 - accuracy: 0.6865
Epoch 14/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5927 - accuracy: 0.6877
Epoch 15/26
20000/20000 [==============================] - 0s 6us/step - loss: 0.5918 - accuracy: 0.6877
Epoch 16/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5912 - accuracy: 0.6874
Epoch 17/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5904 - accuracy: 0.6887
Epoch 18/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5895 - accuracy: 0.6893
Epoch 19/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5887 - accuracy: 0.6895
Epoch 20/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5879 - accuracy: 0.6901
Epoch 21/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5871 - accuracy: 0.6898
Epoch 22/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5868 - accuracy: 0.6891
Epoch 23/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5858 - accuracy: 0.6905
Epoch 24/26
20000/20000 [==============================] - 0s 6us/step - loss: 0.5850 - accuracy: 0.6909
Epoch 25/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5840 - accuracy: 0.6914
Epoch 26/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5838 - accuracy: 0.6909
5697/5697 [==============================] - 0s 18us/step
Epoch 1/27
20000/20000 [==============================] - 0s 11us/step - loss: 0.6592 - accuracy: 0.6320
Epoch 2/27
20000/20000 [==============================] - 0s 6us/step - loss: 0.6198 - accuracy: 0.6779
Epoch 3/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6108 - accuracy: 0.6813
Epoch 4/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6070 - accuracy: 0.6822
Epoch 5/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6042 - accuracy: 0.6830
Epoch 6/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6020 - accuracy: 0.6844
Epoch 7/27
20000/20000 [==============================] - 0s 6us/step - loss: 0.6006 - accuracy: 0.6854
Epoch 8/27
20000/20000 [==============================] - 0s 6us/step - loss: 0.5992 - accuracy: 0.6856
Epoch 9/27
20000/20000 [==============================] - 0s 6us/step - loss: 0.5979 - accuracy: 0.6861
Epoch 10/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5975 - accuracy: 0.6862
Epoch 11/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5960 - accuracy: 0.6860
Epoch 12/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5947 - accuracy: 0.6870
Epoch 13/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5938 - accuracy: 0.6870
Epoch 14/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5933 - accuracy: 0.6880
Epoch 15/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5924 - accuracy: 0.6876
Epoch 16/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5914 - accuracy: 0.6878
Epoch 17/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5910 - accuracy: 0.6884
Epoch 18/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5897 - accuracy: 0.6893
Epoch 19/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5894 - accuracy: 0.6895
Epoch 20/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5885 - accuracy: 0.6906
Epoch 21/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5882 - accuracy: 0.6889
Epoch 22/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5878 - accuracy: 0.6888
Epoch 23/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5868 - accuracy: 0.6917
Epoch 24/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5856 - accuracy: 0.6911
Epoch 25/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5857 - accuracy: 0.6902
Epoch 26/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5849 - accuracy: 0.6927
Epoch 27/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5842 - accuracy: 0.6910
5697/5697 [==============================] - 0s 19us/step
Epoch 1/28
20000/20000 [==============================] - 0s 12us/step - loss: 0.6636 - accuracy: 0.6270
Epoch 2/28
20000/20000 [==============================] - 0s 6us/step - loss: 0.6180 - accuracy: 0.6791
Epoch 3/28
20000/20000 [==============================] - 0s 6us/step - loss: 0.6087 - accuracy: 0.6816
Epoch 4/28
20000/20000 [==============================] - 0s 6us/step - loss: 0.6048 - accuracy: 0.6834
Epoch 5/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6020 - accuracy: 0.6837
Epoch 6/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5994 - accuracy: 0.6837
Epoch 7/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5983 - accuracy: 0.6865
Epoch 8/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5972 - accuracy: 0.6852
Epoch 9/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5954 - accuracy: 0.6866
Epoch 10/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5947 - accuracy: 0.6859
Epoch 11/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5936 - accuracy: 0.6868
Epoch 12/28
20000/20000 [==============================] - 0s 6us/step - loss: 0.5922 - accuracy: 0.6876
Epoch 13/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5914 - accuracy: 0.6884
Epoch 14/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5907 - accuracy: 0.6880
Epoch 15/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5897 - accuracy: 0.6875
Epoch 16/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5888 - accuracy: 0.6885
Epoch 17/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5879 - accuracy: 0.6889
Epoch 18/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5872 - accuracy: 0.6899
Epoch 19/28
20000/20000 [==============================] - 0s 6us/step - loss: 0.5866 - accuracy: 0.6910
Epoch 20/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5856 - accuracy: 0.6919
Epoch 21/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5851 - accuracy: 0.6908
Epoch 22/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5843 - accuracy: 0.6926
Epoch 23/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5834 - accuracy: 0.6920
Epoch 24/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5825 - accuracy: 0.6933
Epoch 25/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5822 - accuracy: 0.6946
Epoch 26/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5813 - accuracy: 0.6942
Epoch 27/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5805 - accuracy: 0.6952
Epoch 28/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5803 - accuracy: 0.6941
5697/5697 [==============================] - 0s 20us/step
Epoch 1/29
20000/20000 [==============================] - 0s 11us/step - loss: 0.6759 - accuracy: 0.6162
Epoch 2/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.6213 - accuracy: 0.6780
Epoch 3/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.6111 - accuracy: 0.6818
Epoch 4/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.6066 - accuracy: 0.6829
Epoch 5/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6037 - accuracy: 0.6829
Epoch 6/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.6019 - accuracy: 0.6842
Epoch 7/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.5997 - accuracy: 0.6840
Epoch 8/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5985 - accuracy: 0.6837
Epoch 9/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5974 - accuracy: 0.6860
Epoch 10/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5959 - accuracy: 0.6873
Epoch 11/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5947 - accuracy: 0.6878
Epoch 12/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5935 - accuracy: 0.6874
Epoch 13/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5931 - accuracy: 0.6869
Epoch 14/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5924 - accuracy: 0.6881
Epoch 15/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5911 - accuracy: 0.6884
Epoch 16/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5906 - accuracy: 0.6888
Epoch 17/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5899 - accuracy: 0.6892
Epoch 18/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5888 - accuracy: 0.6906
Epoch 19/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5881 - accuracy: 0.6884
Epoch 20/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5877 - accuracy: 0.6908
Epoch 21/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5872 - accuracy: 0.6900
Epoch 22/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5860 - accuracy: 0.6902
Epoch 23/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5859 - accuracy: 0.6908
Epoch 24/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5853 - accuracy: 0.6916
Epoch 25/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5845 - accuracy: 0.6910
Epoch 26/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5838 - accuracy: 0.6927
Epoch 27/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5832 - accuracy: 0.6930
Epoch 28/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5828 - accuracy: 0.6927
Epoch 29/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5820 - accuracy: 0.6940
5697/5697 [==============================] - 0s 20us/step
Epoch 1/30
20000/20000 [==============================] - 0s 11us/step - loss: 0.6657 - accuracy: 0.6204
Epoch 2/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6219 - accuracy: 0.6765
Epoch 3/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6114 - accuracy: 0.6791
Epoch 4/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.6067 - accuracy: 0.6816
Epoch 5/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6041 - accuracy: 0.6822
Epoch 6/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.6018 - accuracy: 0.6828
Epoch 7/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.6002 - accuracy: 0.6847
Epoch 8/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5982 - accuracy: 0.6851
Epoch 9/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.5974 - accuracy: 0.6852
Epoch 10/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.5961 - accuracy: 0.6858
Epoch 11/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5950 - accuracy: 0.6855
Epoch 12/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5939 - accuracy: 0.6864
Epoch 13/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5932 - accuracy: 0.6862
Epoch 14/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5922 - accuracy: 0.6868
Epoch 15/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5914 - accuracy: 0.6872
Epoch 16/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5905 - accuracy: 0.6873
Epoch 17/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5899 - accuracy: 0.6870
Epoch 18/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5892 - accuracy: 0.6873
Epoch 19/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5883 - accuracy: 0.6890
Epoch 20/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.5876 - accuracy: 0.6883
Epoch 21/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5868 - accuracy: 0.6888
Epoch 22/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5864 - accuracy: 0.6880
Epoch 23/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.5856 - accuracy: 0.6898
Epoch 24/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5846 - accuracy: 0.6908
Epoch 25/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5844 - accuracy: 0.6898
Epoch 26/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5838 - accuracy: 0.6907
Epoch 27/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5829 - accuracy: 0.6915
Epoch 28/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5826 - accuracy: 0.6920
Epoch 29/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5823 - accuracy: 0.6913
Epoch 30/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5818 - accuracy: 0.6908
5697/5697 [==============================] - 0s 18us/step
Epoch 1/7
20000/20000 [==============================] - 0s 18us/step - loss: 0.6511 - accuracy: 0.6442
Epoch 2/7
20000/20000 [==============================] - 0s 6us/step - loss: 0.6167 - accuracy: 0.6794
Epoch 3/7
20000/20000 [==============================] - 0s 5us/step - loss: 0.6093 - accuracy: 0.6816
Epoch 4/7
20000/20000 [==============================] - 0s 5us/step - loss: 0.6060 - accuracy: 0.6812
Epoch 5/7
20000/20000 [==============================] - 0s 5us/step - loss: 0.6027 - accuracy: 0.6834
Epoch 6/7
20000/20000 [==============================] - 0s 5us/step - loss: 0.6014 - accuracy: 0.6829
Epoch 7/7
20000/20000 [==============================] - 0s 5us/step - loss: 0.5993 - accuracy: 0.6845
5697/5697 [==============================] - 0s 19us/step
Epoch 1/8
20000/20000 [==============================] - 0s 11us/step - loss: 0.6496 - accuracy: 0.6414
Epoch 2/8
20000/20000 [==============================] - 0s 6us/step - loss: 0.6165 - accuracy: 0.6795
Epoch 3/8
20000/20000 [==============================] - 0s 6us/step - loss: 0.6094 - accuracy: 0.6824
Epoch 4/8
20000/20000 [==============================] - 0s 5us/step - loss: 0.6052 - accuracy: 0.6827
Epoch 5/8
20000/20000 [==============================] - 0s 5us/step - loss: 0.6029 - accuracy: 0.6837
Epoch 6/8
20000/20000 [==============================] - 0s 5us/step - loss: 0.6014 - accuracy: 0.6844
Epoch 7/8
20000/20000 [==============================] - 0s 5us/step - loss: 0.5999 - accuracy: 0.6837
Epoch 8/8
20000/20000 [==============================] - 0s 5us/step - loss: 0.5981 - accuracy: 0.6850
5697/5697 [==============================] - 0s 20us/step
Epoch 1/9
20000/20000 [==============================] - 0s 11us/step - loss: 0.6442 - accuracy: 0.6465
Epoch 2/9
20000/20000 [==============================] - 0s 6us/step - loss: 0.6147 - accuracy: 0.6803
Epoch 3/9
20000/20000 [==============================] - 0s 6us/step - loss: 0.6086 - accuracy: 0.6815
Epoch 4/9
20000/20000 [==============================] - 0s 7us/step - loss: 0.6056 - accuracy: 0.6817
Epoch 5/9
20000/20000 [==============================] - 0s 7us/step - loss: 0.6028 - accuracy: 0.6844
Epoch 6/9
20000/20000 [==============================] - 0s 5us/step - loss: 0.6012 - accuracy: 0.6829
Epoch 7/9
20000/20000 [==============================] - 0s 5us/step - loss: 0.5992 - accuracy: 0.6848
Epoch 8/9
20000/20000 [==============================] - 0s 5us/step - loss: 0.5979 - accuracy: 0.6840
Epoch 9/9
20000/20000 [==============================] - 0s 5us/step - loss: 0.5968 - accuracy: 0.6866
5697/5697 [==============================] - 0s 20us/step
Epoch 1/10
20000/20000 [==============================] - 0s 12us/step - loss: 0.6479 - accuracy: 0.6471
Epoch 2/10
20000/20000 [==============================] - 0s 6us/step - loss: 0.6156 - accuracy: 0.6804
Epoch 3/10
20000/20000 [==============================] - 0s 6us/step - loss: 0.6092 - accuracy: 0.6824
Epoch 4/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.6050 - accuracy: 0.6837
Epoch 5/10
20000/20000 [==============================] - 0s 6us/step - loss: 0.6025 - accuracy: 0.6836
Epoch 6/10
20000/20000 [==============================] - 0s 6us/step - loss: 0.6001 - accuracy: 0.6849
Epoch 7/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.5986 - accuracy: 0.6845
Epoch 8/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.5971 - accuracy: 0.6847
Epoch 9/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.5956 - accuracy: 0.6858
Epoch 10/10
20000/20000 [==============================] - 0s 5us/step - loss: 0.5941 - accuracy: 0.6871
5697/5697 [==============================] - 0s 20us/step
Epoch 1/11
20000/20000 [==============================] - 0s 12us/step - loss: 0.6438 - accuracy: 0.6534
Epoch 2/11
20000/20000 [==============================] - 0s 6us/step - loss: 0.6150 - accuracy: 0.6794
Epoch 3/11
20000/20000 [==============================] - 0s 6us/step - loss: 0.6083 - accuracy: 0.6811
Epoch 4/11
20000/20000 [==============================] - 0s 6us/step - loss: 0.6045 - accuracy: 0.6834
Epoch 5/11
20000/20000 [==============================] - 0s 6us/step - loss: 0.6025 - accuracy: 0.6838
Epoch 6/11
20000/20000 [==============================] - 0s 6us/step - loss: 0.6007 - accuracy: 0.6848
Epoch 7/11
20000/20000 [==============================] - 0s 6us/step - loss: 0.5985 - accuracy: 0.6851
Epoch 8/11
20000/20000 [==============================] - 0s 6us/step - loss: 0.5979 - accuracy: 0.6860
Epoch 9/11
20000/20000 [==============================] - 0s 7us/step - loss: 0.5957 - accuracy: 0.6870
Epoch 10/11
20000/20000 [==============================] - 0s 6us/step - loss: 0.5947 - accuracy: 0.6866
Epoch 11/11
20000/20000 [==============================] - 0s 6us/step - loss: 0.5942 - accuracy: 0.6880
5697/5697 [==============================] - 0s 19us/step
Epoch 1/12
20000/20000 [==============================] - 0s 12us/step - loss: 0.6484 - accuracy: 0.6420
Epoch 2/12
20000/20000 [==============================] - 0s 6us/step - loss: 0.6167 - accuracy: 0.6780
Epoch 3/12
20000/20000 [==============================] - 0s 6us/step - loss: 0.6099 - accuracy: 0.6808
Epoch 4/12
20000/20000 [==============================] - 0s 6us/step - loss: 0.6064 - accuracy: 0.6817
Epoch 5/12
20000/20000 [==============================] - 0s 6us/step - loss: 0.6036 - accuracy: 0.6825
Epoch 6/12
20000/20000 [==============================] - 0s 6us/step - loss: 0.6015 - accuracy: 0.6836
Epoch 7/12
20000/20000 [==============================] - 0s 6us/step - loss: 0.6001 - accuracy: 0.6844
Epoch 8/12
20000/20000 [==============================] - 0s 6us/step - loss: 0.5983 - accuracy: 0.6855
Epoch 9/12
20000/20000 [==============================] - 0s 5us/step - loss: 0.5968 - accuracy: 0.6845
Epoch 10/12
20000/20000 [==============================] - 0s 6us/step - loss: 0.5959 - accuracy: 0.6860
Epoch 11/12
20000/20000 [==============================] - 0s 6us/step - loss: 0.5944 - accuracy: 0.6857
Epoch 12/12
20000/20000 [==============================] - 0s 6us/step - loss: 0.5936 - accuracy: 0.6848
5697/5697 [==============================] - 0s 20us/step
Epoch 1/13
20000/20000 [==============================] - 0s 12us/step - loss: 0.6518 - accuracy: 0.6393
Epoch 2/13
20000/20000 [==============================] - 0s 6us/step - loss: 0.6181 - accuracy: 0.6800
Epoch 3/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6109 - accuracy: 0.6816
Epoch 4/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6071 - accuracy: 0.6822
Epoch 5/13
20000/20000 [==============================] - 0s 6us/step - loss: 0.6039 - accuracy: 0.6829
Epoch 6/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6022 - accuracy: 0.6848
Epoch 7/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.6007 - accuracy: 0.6857
Epoch 8/13
20000/20000 [==============================] - 0s 6us/step - loss: 0.5988 - accuracy: 0.6856
Epoch 9/13
20000/20000 [==============================] - 0s 6us/step - loss: 0.5974 - accuracy: 0.6870
Epoch 10/13
20000/20000 [==============================] - 0s 6us/step - loss: 0.5967 - accuracy: 0.6873
Epoch 11/13
20000/20000 [==============================] - 0s 6us/step - loss: 0.5947 - accuracy: 0.6874
Epoch 12/13
20000/20000 [==============================] - 0s 6us/step - loss: 0.5942 - accuracy: 0.6884
Epoch 13/13
20000/20000 [==============================] - 0s 5us/step - loss: 0.5930 - accuracy: 0.6891
5697/5697 [==============================] - 0s 19us/step
Epoch 1/14
20000/20000 [==============================] - 0s 12us/step - loss: 0.6482 - accuracy: 0.6482
Epoch 2/14
20000/20000 [==============================] - 0s 6us/step - loss: 0.6164 - accuracy: 0.6786
Epoch 3/14
20000/20000 [==============================] - 0s 6us/step - loss: 0.6100 - accuracy: 0.6811
Epoch 4/14
20000/20000 [==============================] - 0s 6us/step - loss: 0.6060 - accuracy: 0.6809
Epoch 5/14
20000/20000 [==============================] - 0s 6us/step - loss: 0.6036 - accuracy: 0.6842
Epoch 6/14
20000/20000 [==============================] - 0s 6us/step - loss: 0.6013 - accuracy: 0.6837
Epoch 7/14
20000/20000 [==============================] - 0s 6us/step - loss: 0.6003 - accuracy: 0.6830
Epoch 8/14
20000/20000 [==============================] - 0s 6us/step - loss: 0.5983 - accuracy: 0.6855
Epoch 9/14
20000/20000 [==============================] - 0s 6us/step - loss: 0.5970 - accuracy: 0.6850
Epoch 10/14
20000/20000 [==============================] - 0s 6us/step - loss: 0.5966 - accuracy: 0.6850
Epoch 11/14
20000/20000 [==============================] - 0s 6us/step - loss: 0.5947 - accuracy: 0.6859
Epoch 12/14
20000/20000 [==============================] - 0s 6us/step - loss: 0.5941 - accuracy: 0.6851
Epoch 13/14
20000/20000 [==============================] - 0s 6us/step - loss: 0.5930 - accuracy: 0.6858
Epoch 14/14
20000/20000 [==============================] - 0s 6us/step - loss: 0.5928 - accuracy: 0.6870
5697/5697 [==============================] - 0s 20us/step
Epoch 1/15
20000/20000 [==============================] - 0s 12us/step - loss: 0.6480 - accuracy: 0.6443
Epoch 2/15
20000/20000 [==============================] - 0s 6us/step - loss: 0.6169 - accuracy: 0.6801
Epoch 3/15
20000/20000 [==============================] - 0s 6us/step - loss: 0.6098 - accuracy: 0.6811
Epoch 4/15
20000/20000 [==============================] - 0s 6us/step - loss: 0.6068 - accuracy: 0.6820
Epoch 5/15
20000/20000 [==============================] - 0s 6us/step - loss: 0.6041 - accuracy: 0.6836
Epoch 6/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6020 - accuracy: 0.6848
Epoch 7/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.6006 - accuracy: 0.6837
Epoch 8/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.5981 - accuracy: 0.6855
Epoch 9/15
20000/20000 [==============================] - 0s 6us/step - loss: 0.5968 - accuracy: 0.6851
Epoch 10/15
20000/20000 [==============================] - 0s 6us/step - loss: 0.5956 - accuracy: 0.6869
Epoch 11/15
20000/20000 [==============================] - 0s 6us/step - loss: 0.5952 - accuracy: 0.6855
Epoch 12/15
20000/20000 [==============================] - 0s 6us/step - loss: 0.5940 - accuracy: 0.6881
Epoch 13/15
20000/20000 [==============================] - 0s 6us/step - loss: 0.5924 - accuracy: 0.6884
Epoch 14/15
20000/20000 [==============================] - 0s 5us/step - loss: 0.5919 - accuracy: 0.6877
Epoch 15/15
20000/20000 [==============================] - 0s 6us/step - loss: 0.5906 - accuracy: 0.6886
5697/5697 [==============================] - 0s 22us/step
Epoch 1/16
20000/20000 [==============================] - 0s 12us/step - loss: 0.6447 - accuracy: 0.6443
Epoch 2/16
20000/20000 [==============================] - 0s 6us/step - loss: 0.6149 - accuracy: 0.6795
Epoch 3/16
20000/20000 [==============================] - 0s 6us/step - loss: 0.6079 - accuracy: 0.6825
Epoch 4/16
20000/20000 [==============================] - 0s 6us/step - loss: 0.6038 - accuracy: 0.6827
Epoch 5/16
20000/20000 [==============================] - 0s 6us/step - loss: 0.6015 - accuracy: 0.6847
Epoch 6/16
20000/20000 [==============================] - 0s 6us/step - loss: 0.5999 - accuracy: 0.6862
Epoch 7/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.5977 - accuracy: 0.6854
Epoch 8/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.5966 - accuracy: 0.6859
Epoch 9/16
20000/20000 [==============================] - 0s 6us/step - loss: 0.5952 - accuracy: 0.6866
Epoch 10/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.5936 - accuracy: 0.6880
Epoch 11/16
20000/20000 [==============================] - 0s 6us/step - loss: 0.5927 - accuracy: 0.6869
Epoch 12/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.5915 - accuracy: 0.6872
Epoch 13/16
20000/20000 [==============================] - 0s 5us/step - loss: 0.5906 - accuracy: 0.6884
Epoch 14/16
20000/20000 [==============================] - 0s 6us/step - loss: 0.5890 - accuracy: 0.6893
Epoch 15/16
20000/20000 [==============================] - 0s 6us/step - loss: 0.5888 - accuracy: 0.6880
Epoch 16/16
20000/20000 [==============================] - 0s 6us/step - loss: 0.5877 - accuracy: 0.6887
5697/5697 [==============================] - 0s 19us/step
Epoch 1/17
20000/20000 [==============================] - 0s 12us/step - loss: 0.6543 - accuracy: 0.6381
Epoch 2/17
20000/20000 [==============================] - 0s 6us/step - loss: 0.6201 - accuracy: 0.6783
Epoch 3/17
20000/20000 [==============================] - 0s 6us/step - loss: 0.6117 - accuracy: 0.6803
Epoch 4/17
20000/20000 [==============================] - 0s 6us/step - loss: 0.6070 - accuracy: 0.6810
Epoch 5/17
20000/20000 [==============================] - 0s 6us/step - loss: 0.6038 - accuracy: 0.6816
Epoch 6/17
20000/20000 [==============================] - 0s 6us/step - loss: 0.6021 - accuracy: 0.6827
Epoch 7/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.6003 - accuracy: 0.6847
Epoch 8/17
20000/20000 [==============================] - 0s 6us/step - loss: 0.5983 - accuracy: 0.6840
Epoch 9/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.5968 - accuracy: 0.6847
Epoch 10/17
20000/20000 [==============================] - 0s 6us/step - loss: 0.5959 - accuracy: 0.6855
Epoch 11/17
20000/20000 [==============================] - 0s 6us/step - loss: 0.5940 - accuracy: 0.6868
Epoch 12/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.5935 - accuracy: 0.6866
Epoch 13/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.5921 - accuracy: 0.6873
Epoch 14/17
20000/20000 [==============================] - 0s 6us/step - loss: 0.5912 - accuracy: 0.6874
Epoch 15/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.5902 - accuracy: 0.6883
Epoch 16/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.5895 - accuracy: 0.6886
Epoch 17/17
20000/20000 [==============================] - 0s 5us/step - loss: 0.5888 - accuracy: 0.6884
5697/5697 [==============================] - 0s 19us/step
Epoch 1/18
20000/20000 [==============================] - 0s 12us/step - loss: 0.6564 - accuracy: 0.6357
Epoch 2/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.6181 - accuracy: 0.6784
Epoch 3/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.6096 - accuracy: 0.6816
Epoch 4/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.6058 - accuracy: 0.6823
Epoch 5/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.6028 - accuracy: 0.6837
Epoch 6/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.6005 - accuracy: 0.6849
Epoch 7/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.5987 - accuracy: 0.6848
Epoch 8/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5963 - accuracy: 0.6862
Epoch 9/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5948 - accuracy: 0.6858
Epoch 10/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5942 - accuracy: 0.6866
Epoch 11/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.5926 - accuracy: 0.6869
Epoch 12/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.5910 - accuracy: 0.6875
Epoch 13/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.5910 - accuracy: 0.6887
Epoch 14/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.5898 - accuracy: 0.6892
Epoch 15/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5885 - accuracy: 0.6892
Epoch 16/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.5879 - accuracy: 0.6898
Epoch 17/18
20000/20000 [==============================] - 0s 6us/step - loss: 0.5873 - accuracy: 0.6914
Epoch 18/18
20000/20000 [==============================] - 0s 5us/step - loss: 0.5860 - accuracy: 0.6902
5697/5697 [==============================] - 0s 18us/step
Epoch 1/19
20000/20000 [==============================] - 0s 12us/step - loss: 0.6564 - accuracy: 0.6346
Epoch 2/19
20000/20000 [==============================] - 0s 6us/step - loss: 0.6190 - accuracy: 0.6768
Epoch 3/19
20000/20000 [==============================] - 0s 6us/step - loss: 0.6110 - accuracy: 0.6815
Epoch 4/19
20000/20000 [==============================] - 0s 6us/step - loss: 0.6072 - accuracy: 0.6831
Epoch 5/19
20000/20000 [==============================] - 0s 6us/step - loss: 0.6043 - accuracy: 0.6832
Epoch 6/19
20000/20000 [==============================] - 0s 6us/step - loss: 0.6020 - accuracy: 0.6836
Epoch 7/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.6005 - accuracy: 0.6852
Epoch 8/19
20000/20000 [==============================] - 0s 6us/step - loss: 0.5982 - accuracy: 0.6847
Epoch 9/19
20000/20000 [==============================] - 0s 6us/step - loss: 0.5971 - accuracy: 0.6853
Epoch 10/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5958 - accuracy: 0.6866
Epoch 11/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5945 - accuracy: 0.6864
Epoch 12/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5938 - accuracy: 0.6873
Epoch 13/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5921 - accuracy: 0.6868
Epoch 14/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5915 - accuracy: 0.6869
Epoch 15/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5910 - accuracy: 0.6874
Epoch 16/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5897 - accuracy: 0.6886
Epoch 17/19
20000/20000 [==============================] - 0s 6us/step - loss: 0.5887 - accuracy: 0.6896
Epoch 18/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5876 - accuracy: 0.6894
Epoch 19/19
20000/20000 [==============================] - 0s 5us/step - loss: 0.5873 - accuracy: 0.6890
5697/5697 [==============================] - 0s 19us/step
Epoch 1/20
20000/20000 [==============================] - 0s 12us/step - loss: 0.6468 - accuracy: 0.6500
Epoch 2/20
20000/20000 [==============================] - 0s 6us/step - loss: 0.6183 - accuracy: 0.6805
Epoch 3/20
20000/20000 [==============================] - 0s 6us/step - loss: 0.6107 - accuracy: 0.6829
Epoch 4/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6064 - accuracy: 0.6834
Epoch 5/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6034 - accuracy: 0.6838
Epoch 6/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.6016 - accuracy: 0.6841
Epoch 7/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5995 - accuracy: 0.6852
Epoch 8/20
20000/20000 [==============================] - 0s 6us/step - loss: 0.5982 - accuracy: 0.6855
Epoch 9/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5968 - accuracy: 0.6854
Epoch 10/20
20000/20000 [==============================] - 0s 6us/step - loss: 0.5949 - accuracy: 0.6851
Epoch 11/20
20000/20000 [==============================] - 0s 6us/step - loss: 0.5944 - accuracy: 0.6873
Epoch 12/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5929 - accuracy: 0.6861
Epoch 13/20
20000/20000 [==============================] - 0s 6us/step - loss: 0.5922 - accuracy: 0.6891
Epoch 14/20
20000/20000 [==============================] - 0s 6us/step - loss: 0.5909 - accuracy: 0.6883
Epoch 15/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5899 - accuracy: 0.6887
Epoch 16/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5889 - accuracy: 0.6903
Epoch 17/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5888 - accuracy: 0.6902
Epoch 18/20
20000/20000 [==============================] - 0s 6us/step - loss: 0.5875 - accuracy: 0.6892
Epoch 19/20
20000/20000 [==============================] - 0s 6us/step - loss: 0.5867 - accuracy: 0.6906
Epoch 20/20
20000/20000 [==============================] - 0s 5us/step - loss: 0.5865 - accuracy: 0.6907
5697/5697 [==============================] - 0s 20us/step
Epoch 1/21
20000/20000 [==============================] - 0s 12us/step - loss: 0.6535 - accuracy: 0.6396
Epoch 2/21
20000/20000 [==============================] - 0s 6us/step - loss: 0.6184 - accuracy: 0.6781
Epoch 3/21
20000/20000 [==============================] - 0s 6us/step - loss: 0.6098 - accuracy: 0.6804
Epoch 4/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6061 - accuracy: 0.6819
Epoch 5/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.6035 - accuracy: 0.6819
Epoch 6/21
20000/20000 [==============================] - 0s 6us/step - loss: 0.6013 - accuracy: 0.6836
Epoch 7/21
20000/20000 [==============================] - 0s 6us/step - loss: 0.5992 - accuracy: 0.6845
Epoch 8/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5979 - accuracy: 0.6861
Epoch 9/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5968 - accuracy: 0.6851
Epoch 10/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5948 - accuracy: 0.6870
Epoch 11/21
20000/20000 [==============================] - 0s 6us/step - loss: 0.5938 - accuracy: 0.6880
Epoch 12/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5926 - accuracy: 0.6880
Epoch 13/21
20000/20000 [==============================] - 0s 6us/step - loss: 0.5919 - accuracy: 0.6885
Epoch 14/21
20000/20000 [==============================] - 0s 6us/step - loss: 0.5908 - accuracy: 0.6874
Epoch 15/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5900 - accuracy: 0.6895
Epoch 16/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5894 - accuracy: 0.6903
Epoch 17/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5883 - accuracy: 0.6901
Epoch 18/21
20000/20000 [==============================] - 0s 6us/step - loss: 0.5873 - accuracy: 0.6902
Epoch 19/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5863 - accuracy: 0.6913
Epoch 20/21
20000/20000 [==============================] - 0s 6us/step - loss: 0.5858 - accuracy: 0.6908
Epoch 21/21
20000/20000 [==============================] - 0s 5us/step - loss: 0.5849 - accuracy: 0.6915
5697/5697 [==============================] - 0s 19us/step
Epoch 1/22
20000/20000 [==============================] - 0s 12us/step - loss: 0.6622 - accuracy: 0.6202
Epoch 2/22
20000/20000 [==============================] - 0s 6us/step - loss: 0.6193 - accuracy: 0.6784
Epoch 3/22
20000/20000 [==============================] - 0s 6us/step - loss: 0.6113 - accuracy: 0.6819
Epoch 4/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6062 - accuracy: 0.6830
Epoch 5/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6037 - accuracy: 0.6836
Epoch 6/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6009 - accuracy: 0.6834
Epoch 7/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.6001 - accuracy: 0.6845
Epoch 8/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5979 - accuracy: 0.6857
Epoch 9/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5965 - accuracy: 0.6868
Epoch 10/22
20000/20000 [==============================] - 0s 6us/step - loss: 0.5950 - accuracy: 0.6883
Epoch 11/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5945 - accuracy: 0.6880
Epoch 12/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5927 - accuracy: 0.6883
Epoch 13/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5925 - accuracy: 0.6907
Epoch 14/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5911 - accuracy: 0.6896
Epoch 15/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5901 - accuracy: 0.6888
Epoch 16/22
20000/20000 [==============================] - 0s 6us/step - loss: 0.5896 - accuracy: 0.6892
Epoch 17/22
20000/20000 [==============================] - 0s 6us/step - loss: 0.5886 - accuracy: 0.6899
Epoch 18/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5877 - accuracy: 0.6910
Epoch 19/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5873 - accuracy: 0.6905: 0s - loss: 0.5846 - accuracy: 0.
Epoch 20/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5855 - accuracy: 0.6896
Epoch 21/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5847 - accuracy: 0.6906
Epoch 22/22
20000/20000 [==============================] - 0s 5us/step - loss: 0.5843 - accuracy: 0.6913
5697/5697 [==============================] - 0s 18us/step
Epoch 1/23
20000/20000 [==============================] - 0s 12us/step - loss: 0.6469 - accuracy: 0.6491
Epoch 2/23
20000/20000 [==============================] - 0s 6us/step - loss: 0.6166 - accuracy: 0.6788
Epoch 3/23
20000/20000 [==============================] - 0s 6us/step - loss: 0.6098 - accuracy: 0.6826
Epoch 4/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6064 - accuracy: 0.6817
Epoch 5/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6039 - accuracy: 0.6824
Epoch 6/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.6013 - accuracy: 0.6849
Epoch 7/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5998 - accuracy: 0.6838
Epoch 8/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5980 - accuracy: 0.6847
Epoch 9/23
20000/20000 [==============================] - 0s 6us/step - loss: 0.5971 - accuracy: 0.6849
Epoch 10/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5956 - accuracy: 0.6841
Epoch 11/23
20000/20000 [==============================] - 0s 6us/step - loss: 0.5943 - accuracy: 0.6875
Epoch 12/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5933 - accuracy: 0.6856
Epoch 13/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5921 - accuracy: 0.6882
Epoch 14/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5913 - accuracy: 0.6878
Epoch 15/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5906 - accuracy: 0.6879
Epoch 16/23
20000/20000 [==============================] - 0s 6us/step - loss: 0.5896 - accuracy: 0.6879
Epoch 17/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5890 - accuracy: 0.6894
Epoch 18/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5874 - accuracy: 0.6896
Epoch 19/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5870 - accuracy: 0.6895
Epoch 20/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5866 - accuracy: 0.6909
Epoch 21/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5847 - accuracy: 0.6909
Epoch 22/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5847 - accuracy: 0.6899
Epoch 23/23
20000/20000 [==============================] - 0s 5us/step - loss: 0.5831 - accuracy: 0.6918
5697/5697 [==============================] - 0s 19us/step
Epoch 1/24
20000/20000 [==============================] - 0s 11us/step - loss: 0.6515 - accuracy: 0.6388
Epoch 2/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6183 - accuracy: 0.6802
Epoch 3/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6106 - accuracy: 0.6817
Epoch 4/24
20000/20000 [==============================] - 0s 6us/step - loss: 0.6067 - accuracy: 0.6827
Epoch 5/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.6036 - accuracy: 0.6834
Epoch 6/24
20000/20000 [==============================] - 0s 6us/step - loss: 0.6016 - accuracy: 0.6830
Epoch 7/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5992 - accuracy: 0.6849
Epoch 8/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5978 - accuracy: 0.6850
Epoch 9/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5963 - accuracy: 0.6881
Epoch 10/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5956 - accuracy: 0.6866
Epoch 11/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5937 - accuracy: 0.6870
Epoch 12/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5928 - accuracy: 0.6879
Epoch 13/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5916 - accuracy: 0.6872
Epoch 14/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5908 - accuracy: 0.6884
Epoch 15/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5893 - accuracy: 0.6886
Epoch 16/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5887 - accuracy: 0.6878
Epoch 17/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5876 - accuracy: 0.6888
Epoch 18/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5871 - accuracy: 0.6899
Epoch 19/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5855 - accuracy: 0.6901
Epoch 20/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5848 - accuracy: 0.6910
Epoch 21/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5844 - accuracy: 0.6905
Epoch 22/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5829 - accuracy: 0.6909
Epoch 23/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5823 - accuracy: 0.6923
Epoch 24/24
20000/20000 [==============================] - 0s 5us/step - loss: 0.5814 - accuracy: 0.6917
5697/5697 [==============================] - 0s 21us/step
Epoch 1/25
20000/20000 [==============================] - 0s 11us/step - loss: 0.6602 - accuracy: 0.6283
Epoch 2/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.6195 - accuracy: 0.6780
Epoch 3/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.6103 - accuracy: 0.6811
Epoch 4/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.6065 - accuracy: 0.6827
Epoch 5/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.6039 - accuracy: 0.6837
Epoch 6/25
20000/20000 [==============================] - 0s 6us/step - loss: 0.6013 - accuracy: 0.6833
Epoch 7/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5997 - accuracy: 0.6855
Epoch 8/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5981 - accuracy: 0.6853
Epoch 9/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5975 - accuracy: 0.6856
Epoch 10/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5957 - accuracy: 0.6854
Epoch 11/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5944 - accuracy: 0.6869
Epoch 12/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5934 - accuracy: 0.6863
Epoch 13/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5926 - accuracy: 0.6877
Epoch 14/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5914 - accuracy: 0.6866
Epoch 15/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5909 - accuracy: 0.6884
Epoch 16/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5897 - accuracy: 0.6885
Epoch 17/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5887 - accuracy: 0.6879
Epoch 18/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5882 - accuracy: 0.6901
Epoch 19/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5874 - accuracy: 0.6901
Epoch 20/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5865 - accuracy: 0.6891
Epoch 21/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5854 - accuracy: 0.6903
Epoch 22/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5847 - accuracy: 0.6898
Epoch 23/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5836 - accuracy: 0.6922
Epoch 24/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5830 - accuracy: 0.6902
Epoch 25/25
20000/20000 [==============================] - 0s 5us/step - loss: 0.5824 - accuracy: 0.6910
5697/5697 [==============================] - 0s 19us/step
Epoch 1/26
20000/20000 [==============================] - 0s 11us/step - loss: 0.6503 - accuracy: 0.6451
Epoch 2/26
20000/20000 [==============================] - 0s 6us/step - loss: 0.6166 - accuracy: 0.6801
Epoch 3/26
20000/20000 [==============================] - 0s 6us/step - loss: 0.6089 - accuracy: 0.6817
Epoch 4/26
20000/20000 [==============================] - 0s 6us/step - loss: 0.6056 - accuracy: 0.6834
Epoch 5/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6025 - accuracy: 0.6835
Epoch 6/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.6013 - accuracy: 0.6840
Epoch 7/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5993 - accuracy: 0.6844
Epoch 8/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5974 - accuracy: 0.6859
Epoch 9/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5964 - accuracy: 0.6859
Epoch 10/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5947 - accuracy: 0.6870
Epoch 11/26
20000/20000 [==============================] - 0s 6us/step - loss: 0.5942 - accuracy: 0.6872
Epoch 12/26
20000/20000 [==============================] - 0s 6us/step - loss: 0.5933 - accuracy: 0.6855
Epoch 13/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5915 - accuracy: 0.6886
Epoch 14/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5907 - accuracy: 0.6874
Epoch 15/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5901 - accuracy: 0.6881
Epoch 16/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5894 - accuracy: 0.6880
Epoch 17/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5879 - accuracy: 0.6885
Epoch 18/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5877 - accuracy: 0.6898
Epoch 19/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5866 - accuracy: 0.6898
Epoch 20/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5856 - accuracy: 0.6898
Epoch 21/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5851 - accuracy: 0.6893
Epoch 22/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5840 - accuracy: 0.6900
Epoch 23/26
20000/20000 [==============================] - 0s 6us/step - loss: 0.5836 - accuracy: 0.6906
Epoch 24/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5830 - accuracy: 0.6919
Epoch 25/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5816 - accuracy: 0.6910
Epoch 26/26
20000/20000 [==============================] - 0s 5us/step - loss: 0.5812 - accuracy: 0.6934
5697/5697 [==============================] - 0s 19us/step
Epoch 1/27
20000/20000 [==============================] - 0s 11us/step - loss: 0.6591 - accuracy: 0.6368
Epoch 2/27
20000/20000 [==============================] - 0s 6us/step - loss: 0.6182 - accuracy: 0.6804
Epoch 3/27
20000/20000 [==============================] - 0s 6us/step - loss: 0.6108 - accuracy: 0.6806
Epoch 4/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6062 - accuracy: 0.6829
Epoch 5/27
20000/20000 [==============================] - 0s 6us/step - loss: 0.6030 - accuracy: 0.6834
Epoch 6/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.6008 - accuracy: 0.6841
Epoch 7/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5990 - accuracy: 0.6866
Epoch 8/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5982 - accuracy: 0.6852
Epoch 9/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5962 - accuracy: 0.6851
Epoch 10/27
20000/20000 [==============================] - 0s 6us/step - loss: 0.5953 - accuracy: 0.6860
Epoch 11/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5942 - accuracy: 0.6866
Epoch 12/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5930 - accuracy: 0.6870
Epoch 13/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5920 - accuracy: 0.6872
Epoch 14/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5914 - accuracy: 0.6874
Epoch 15/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5899 - accuracy: 0.6877
Epoch 16/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5892 - accuracy: 0.6889
Epoch 17/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5882 - accuracy: 0.6884
Epoch 18/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5875 - accuracy: 0.6901
Epoch 19/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5864 - accuracy: 0.6910
Epoch 20/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5856 - accuracy: 0.6905
Epoch 21/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5852 - accuracy: 0.6916
Epoch 22/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5831 - accuracy: 0.6924
Epoch 23/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5832 - accuracy: 0.6923
Epoch 24/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5821 - accuracy: 0.6924
Epoch 25/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5820 - accuracy: 0.6934
Epoch 26/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5809 - accuracy: 0.6935
Epoch 27/27
20000/20000 [==============================] - 0s 5us/step - loss: 0.5806 - accuracy: 0.6928
5697/5697 [==============================] - 0s 19us/step
Epoch 1/28
20000/20000 [==============================] - 0s 12us/step - loss: 0.6469 - accuracy: 0.6497
Epoch 2/28
20000/20000 [==============================] - 0s 6us/step - loss: 0.6172 - accuracy: 0.6806
Epoch 3/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6096 - accuracy: 0.6828
Epoch 4/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6055 - accuracy: 0.6833
Epoch 5/28
20000/20000 [==============================] - 0s 6us/step - loss: 0.6034 - accuracy: 0.6846
Epoch 6/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.6009 - accuracy: 0.6849
Epoch 7/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5995 - accuracy: 0.6849
Epoch 8/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5978 - accuracy: 0.6860
Epoch 9/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5967 - accuracy: 0.6859
Epoch 10/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5955 - accuracy: 0.6877
Epoch 11/28
20000/20000 [==============================] - 0s 6us/step - loss: 0.5941 - accuracy: 0.6870
Epoch 12/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5934 - accuracy: 0.6877
Epoch 13/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5924 - accuracy: 0.6872
Epoch 14/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5916 - accuracy: 0.6882
Epoch 15/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5904 - accuracy: 0.6891
Epoch 16/28
20000/20000 [==============================] - 0s 6us/step - loss: 0.5894 - accuracy: 0.6891
Epoch 17/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5887 - accuracy: 0.6894
Epoch 18/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5876 - accuracy: 0.6910
Epoch 19/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5873 - accuracy: 0.6907
Epoch 20/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5863 - accuracy: 0.6908
Epoch 21/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5857 - accuracy: 0.6907
Epoch 22/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5844 - accuracy: 0.6920
Epoch 23/28
20000/20000 [==============================] - 0s 6us/step - loss: 0.5847 - accuracy: 0.6924
Epoch 24/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5828 - accuracy: 0.6926
Epoch 25/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5826 - accuracy: 0.6930
Epoch 26/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5815 - accuracy: 0.6932
Epoch 27/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5811 - accuracy: 0.6942
Epoch 28/28
20000/20000 [==============================] - 0s 5us/step - loss: 0.5803 - accuracy: 0.6930
5697/5697 [==============================] - 0s 20us/step
Epoch 1/29
20000/20000 [==============================] - 0s 11us/step - loss: 0.6609 - accuracy: 0.6281
Epoch 2/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.6188 - accuracy: 0.6777
Epoch 3/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6111 - accuracy: 0.6804
Epoch 4/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6061 - accuracy: 0.6819
Epoch 5/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6039 - accuracy: 0.6812
Epoch 6/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.6022 - accuracy: 0.6823
Epoch 7/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5997 - accuracy: 0.6833
Epoch 8/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5983 - accuracy: 0.6838
Epoch 9/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5966 - accuracy: 0.6844
Epoch 10/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5952 - accuracy: 0.6853
Epoch 11/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.5941 - accuracy: 0.6870
Epoch 12/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5932 - accuracy: 0.6874
Epoch 13/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5924 - accuracy: 0.6858
Epoch 14/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5914 - accuracy: 0.6879
Epoch 15/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5898 - accuracy: 0.6874
Epoch 16/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5891 - accuracy: 0.6885
Epoch 17/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5884 - accuracy: 0.6896
Epoch 18/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5873 - accuracy: 0.6903
Epoch 19/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5865 - accuracy: 0.6896
Epoch 20/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5861 - accuracy: 0.6915
Epoch 21/29
20000/20000 [==============================] - 0s 6us/step - loss: 0.5848 - accuracy: 0.6907
Epoch 22/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5841 - accuracy: 0.6925
Epoch 23/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5832 - accuracy: 0.6916
Epoch 24/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5829 - accuracy: 0.6927
Epoch 25/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5814 - accuracy: 0.6933
Epoch 26/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5813 - accuracy: 0.6927
Epoch 27/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5809 - accuracy: 0.6931
Epoch 28/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5798 - accuracy: 0.6938
Epoch 29/29
20000/20000 [==============================] - 0s 5us/step - loss: 0.5793 - accuracy: 0.6937
5697/5697 [==============================] - 0s 20us/step
Epoch 1/30
20000/20000 [==============================] - 0s 11us/step - loss: 0.6455 - accuracy: 0.6499
Epoch 2/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.6156 - accuracy: 0.6806
Epoch 3/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.6084 - accuracy: 0.6822
Epoch 4/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.6049 - accuracy: 0.6830
Epoch 5/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6020 - accuracy: 0.6834
Epoch 6/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.6008 - accuracy: 0.6840
Epoch 7/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5987 - accuracy: 0.6859
Epoch 8/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5970 - accuracy: 0.6845
Epoch 9/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5957 - accuracy: 0.6847
Epoch 10/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5946 - accuracy: 0.6862
Epoch 11/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5936 - accuracy: 0.6860
Epoch 12/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5929 - accuracy: 0.6869
Epoch 13/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5916 - accuracy: 0.6870
Epoch 14/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.5909 - accuracy: 0.6867
Epoch 15/30
20000/20000 [==============================] - 0s 6us/step - loss: 0.5903 - accuracy: 0.6887
Epoch 16/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5889 - accuracy: 0.6890
Epoch 17/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5880 - accuracy: 0.6897
Epoch 18/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5876 - accuracy: 0.6899
Epoch 19/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5867 - accuracy: 0.6895
Epoch 20/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5855 - accuracy: 0.6893
Epoch 21/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5849 - accuracy: 0.6900
Epoch 22/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5849 - accuracy: 0.6909
Epoch 23/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5838 - accuracy: 0.6919
Epoch 24/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5830 - accuracy: 0.6916
Epoch 25/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5831 - accuracy: 0.6913
Epoch 26/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5820 - accuracy: 0.6932
Epoch 27/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5813 - accuracy: 0.6922
Epoch 28/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5807 - accuracy: 0.6918
Epoch 29/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5795 - accuracy: 0.6926
Epoch 30/30
20000/20000 [==============================] - 0s 5us/step - loss: 0.5794 - accuracy: 0.6935
5697/5697 [==============================] - 0s 18us/step
最高的准确率： 0.6805335879325867
最好的参数： [16, 32, 14]

print('最高的准确率：',best_result)
print('最好的参数：',best_param)

最高的准确率： 0.6805335879325867
最好的参数： [16, 32, 14]

model = models.Sequential()
model.add(layers.Dense(16,activation='relu',input_shape=(95,)))
model.add(layers.Dense(32,activation='relu'))
model.add(layers.Dense(1,activation='sigmoid'))
model.compile(optimizer = 'rmsprop',
            loss='binary_crossentropy',
            metrics=['accuracy'])
history = model.fit(x_train,y_train,epochs=14,batch_size=512)
results = model.evaluate(x_test,y_test)
results

Epoch 1/14
20000/20000 [==============================] - 0s 12us/step - loss: 0.6832 - accuracy: 0.5856
Epoch 2/14
20000/20000 [==============================] - 0s 6us/step - loss: 0.6432 - accuracy: 0.6547
Epoch 3/14
20000/20000 [==============================] - 0s 7us/step - loss: 0.6278 - accuracy: 0.6700
Epoch 4/14
20000/20000 [==============================] - 0s 9us/step - loss: 0.6191 - accuracy: 0.6761
Epoch 5/14
20000/20000 [==============================] - 0s 7us/step - loss: 0.6141 - accuracy: 0.6787
Epoch 6/14
20000/20000 [==============================] - 0s 9us/step - loss: 0.6109 - accuracy: 0.6802
Epoch 7/14
20000/20000 [==============================] - 0s 7us/step - loss: 0.6085 - accuracy: 0.6804
Epoch 8/14
20000/20000 [==============================] - 0s 6us/step - loss: 0.6071 - accuracy: 0.6829
Epoch 9/14
20000/20000 [==============================] - 0s 6us/step - loss: 0.6058 - accuracy: 0.6826
Epoch 10/14
20000/20000 [==============================] - 0s 7us/step - loss: 0.6048 - accuracy: 0.6830
Epoch 11/14
20000/20000 [==============================] - 0s 9us/step - loss: 0.6037 - accuracy: 0.6847
Epoch 12/14
20000/20000 [==============================] - 0s 6us/step - loss: 0.6028 - accuracy: 0.6834
Epoch 13/14
20000/20000 [==============================] - 0s 7us/step - loss: 0.6023 - accuracy: 0.6840
Epoch 14/14
20000/20000 [==============================] - 0s 8us/step - loss: 0.6012 - accuracy: 0.6848
5697/5697 [==============================] - 0s 28us/step





[0.6232214123298353, 0.6740389466285706]

model.save('cnn_model.h5')

# 载入
from keras.models import load_model
model = load_model('cnn_model.h5')

x_test.shape
y_test.shape

(5697,)

# 绘制混淆矩阵
from sklearn.metrics import confusion_matrix
y_pred = model.predict(x_test)
y_pred = y_pred.reshape(-1)
for i,pred in enumerate(y_pred):
    if pred>0.5:
        y_pred[i]=1.0
    else:
        y_pred[i]=0.0
print(y_pred.shape)
print(y_test.shape)

(5697,)
(5697,)

c2= confusion_matrix(y_test, y_pred, labels=[0, 1])
c2

array([[2648,  488],
       [1369, 1192]], dtype=int64)

# ROC
from sklearn.metrics import confusion_matrix
from sklearn.metrics import roc_curve, auc, roc_auc_score
model_y_score = model.predict_proba(x_test)
model_y_score = model_y_score.reshape(-1)
model_fpr, model_tpr, _ = roc_curve(y_test,model_y_score, pos_label=1)
plt.plot(model_fpr, model_tpr,
         label='micro-average ROC curve',
         color='g', linewidth=4)
plt.plot([0, 1], [0, 1], 'k--', lw=2,c='r')
plt.title('model roc')
plt.show()

# AUC
model_auc = auc(model_fpr, model_tpr)
model_auc

0.6748694108646973

6.总结

算法	最佳参数	最高准确率	AUC值
KNN	n_neighbors=19	0.64	0.6722211711396529
决策树	criterion= 'gini', max_depth=2, min_samples_leaf= 1	0.674	0.6722211711396529
随机森林	'criterion': 'gini', 'max_depth': 6, 'min_samples_leaf': 2, 'n_estimators': 20	0.6647470817120622	0.683775641474172
支持向量机	kernel='rbf', gamma=0.0021209508879201904, cache_size=5000,C=0.6	0.6765758754863813	0.6695905709814952
神经网络	Dense1:16,Dense2:32,epochs:14	0.6805335879325867	0.6748694108646973

通过预测，使用简单的神经网络有最好的预测准确率

准确率低我想的原因可能是因为，投篮的命中很大程度上与科比的状态有很大的关系，还和防守人，防守强度等其他一系列无法量化的因素有关，所以通过有限的数据能够达到68%也还可以了，kaggle上该数据的比赛也只有60多的准确率

姓名：曾强
日期：2020-6-5